-- Logs begin at Tue 2022-05-31 21:36:36 UTC, end at Tue 2022-05-31 22:58:05 UTC. -- May 31 22:26:14.671198 dv-cinder-844140-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 22:26:14.679478 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 22:26:14 2022] *** May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: nodename: dv-cinder-844140-1-iscsi May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: machine: x86_64 May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: clock source: unix May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: pcre jit disabled May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: detected number of CPU cores: 4 May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: current working directory: / May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: detected binary path: /usr/bin/uwsgi-core May 31 22:26:14.681442 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: your processes number limit is 47680 May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: your memory page size is 4096 bytes May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: detected max file descriptor number: 2048 May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: lock engine: pthread robust mutexes May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: thunder lock: enabled May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 22:26:14.682105 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 22:26:14.726842 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: Python main interpreter initialized at 0x556a1c81c9c0 May 31 22:26:14.726842 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: python threads support enabled May 31 22:26:14.726842 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: your server socket listen backlog is limited to 100 connections May 31 22:26:14.726842 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: your mercy for graceful operations on workers is 90 seconds May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: mapped 403077 bytes (393 KB) for 2 cores May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: *** Operational MODE: preforking *** May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: *** uWSGI is running in multiple interpreter mode *** May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: spawned uWSGI master process (pid: 103705) May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: spawned uWSGI worker 1 (pid: 103706, cores: 1) May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: spawned uWSGI worker 2 (pid: 103707, cores: 1) May 31 22:26:14.731116 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 22:26:14.727698 dv-cinder-844140-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 22:26:15.957536 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 22:26:15.958179 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 22:26:16.672057 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:26:16.672057 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes May 31 22:26:16.672328 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:26:16.672328 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: from cryptography.utils import int_from_bytes May 31 22:26:16.672451 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:26:16.672451 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: from cryptography.utils import int_from_bytes May 31 22:26:16.672562 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:26:16.672562 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: from cryptography.utils import int_from_bytes May 31 22:26:19.267939 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 22:26:19.268661 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 22:26:19.269014 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 22:26:19.269109 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 22:26:19.269204 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 22:26:19.269290 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 22:26:19.269375 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 22:26:19.269480 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 22:26:19.269568 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 22:26:19.269642 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 22:26:19.269723 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.269874 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.269971 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270201 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270296 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270524 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270632 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270866 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.270967 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271199 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271299 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271513 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271606 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271834 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.271920 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272153 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272263 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272409 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272495 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272724 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.272816 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273035 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273131 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-1-iscsi {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273356 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273446 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-1-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273664 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273759 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.273970 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274062 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274284 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274380 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274585 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274676 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.274915 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.275014 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.275223 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.275314 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.275535 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.275718 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276047 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276204 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276385 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276506 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276692 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.276815 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277005 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277119 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277360 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277491 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277654 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277789 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.277963 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278098 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278284 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278410 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278592 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278720 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.278936 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279069 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279246 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279380 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-1-iscsi {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279633 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279810 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-1-iscsi {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.279999 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280152 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280364 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280554 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280554 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280887 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.280887 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.281283 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.281475 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.281638 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.281842 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.281975 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282156 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282354 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282518 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282651 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282801 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.282937 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283069 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283219 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283349 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283487 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283618 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283743 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.283865 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284017 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284149 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284280 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284414 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284570 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284702 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284836 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.284960 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285131 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285266 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285404 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285541 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285672 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285807 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.285937 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286068 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286191 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286320 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286443 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286579 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286711 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.286858 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287004 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287171 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287330 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287456 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287586 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287718 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287843 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.287972 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288104 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288267 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288405 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288575 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288708 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.288882 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289015 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289188 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289321 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289493 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289628 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289795 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.289929 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290099 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290233 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290407 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290540 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290718 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.290873 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291057 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291195 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291365 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291489 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291679 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.291807 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292025 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292152 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292392 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292536 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292667 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292801 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.292957 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293089 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293272 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293473 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293605 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293728 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.293881 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294015 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294341 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294504 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294643 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294830 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.294963 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295138 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295272 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295447 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295580 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295768 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.295894 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296072 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296204 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296337 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296468 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296598 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296723 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.296895 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297023 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297209 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297333 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297517 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297651 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297824 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.297949 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298127 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298261 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298427 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298559 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298725 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.298861 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299059 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299188 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299365 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299497 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299669 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299795 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.299974 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300098 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300278 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300414 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300578 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300713 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.300882 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301006 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301186 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301326 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301489 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301613 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301805 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.301942 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302109 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302246 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302414 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302624 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302758 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.302946 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303080 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303213 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303352 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303475 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303631 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303766 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.303935 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304072 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304240 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304365 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304548 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304671 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304852 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.304991 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305155 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305287 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305458 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305589 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305767 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.305899 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306080 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306212 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306379 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306504 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306686 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.306852 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.307017 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.307140 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.307324 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.307458 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308159 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308295 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308462 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308597 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308766 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.308890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309066 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309197 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309370 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309501 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309667 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309798 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.309967 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310263 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310388 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310559 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310684 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.310899 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311035 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311205 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311329 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311512 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311650 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311814 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.311939 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.312117 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.312252 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.312436 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:26:19.312572 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313031 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313162 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313345 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313474 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313656 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313796 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.313987 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314202 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314339 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314464 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314621 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314755 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.314968 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315096 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315280 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315404 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315597 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315724 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.315907 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316039 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316218 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316344 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316528 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316655 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316839 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.316971 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317155 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317280 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317516 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317653 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317778 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.317899 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318089 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318222 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318402 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318529 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318708 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.318869 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319046 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319365 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319493 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319680 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319805 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.319990 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320118 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320301 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320433 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320640 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320774 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.320950 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321083 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321283 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321409 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321610 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321737 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.321932 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322073 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322246 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322373 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322559 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322686 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.322892 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.323046 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.323912 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324044 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324168 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324292 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324416 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324550 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324721 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.324856 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325036 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325172 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325350 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325487 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325661 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325795 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.325973 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326099 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326284 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326413 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326623 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326751 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.326973 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327100 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327287 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327415 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327598 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327729 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.327908 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328034 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328220 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328346 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328531 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328656 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328835 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.328970 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329140 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329267 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329442 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329568 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329748 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.329890 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330049 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330176 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330351 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330490 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330671 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.330838 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331001 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331130 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331311 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331452 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331628 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331767 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.331935 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332060 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332244 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332376 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332553 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332680 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332859 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.332996 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333161 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333285 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333470 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333596 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333775 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.333916 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334103 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334229 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334390 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334525 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334701 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.334874 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335030 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335172 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335355 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335483 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335664 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335792 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.335971 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336113 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336279 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336404 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336589 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336722 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.336897 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337031 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337204 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337328 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337512 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337644 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337827 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.337970 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338142 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338268 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338455 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338587 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338825 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.338967 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339139 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339267 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339460 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339584 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339786 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.339911 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340103 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340230 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340409 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340546 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340715 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.340841 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341019 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341152 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341325 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341630 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341756 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.341935 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342060 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342239 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342375 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342542 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342669 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342870 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.342997 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343176 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343319 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343478 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343603 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343781 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.343906 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344147 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344374 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344500 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344631 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344754 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.344885 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345009 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345140 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345265 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345398 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345592 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345730 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.345897 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346039 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346238 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346367 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346561 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346686 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.346909 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347039 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347224 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347351 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347536 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347662 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347844 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.347976 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348153 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348278 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348461 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348580 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348771 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.348896 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349084 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349211 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349393 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349519 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349703 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.349828 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350010 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350136 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350319 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350444 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350632 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350758 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.350968 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351092 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351275 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351411 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351586 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351711 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.351902 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352035 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352243 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352382 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352566 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352693 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.352884 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353008 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353196 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353330 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353513 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353651 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353825 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.353952 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354138 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354346 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354490 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354615 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354827 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.354960 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355154 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355283 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355470 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355598 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355782 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.355907 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356093 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356218 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356410 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356546 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356719 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.356852 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357039 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357171 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357342 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357467 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357658 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357791 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.357977 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358112 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358305 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358433 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358614 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358738 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.358956 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359084 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359271 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359402 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359584 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.359897 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360022 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360207 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360340 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360515 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360650 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360820 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.360946 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361128 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361255 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361440 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361578 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361747 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.361872 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362056 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362188 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362361 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362495 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362667 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362815 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.362999 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363134 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363306 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363434 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363608 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363732 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.363914 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364048 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364228 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364368 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364563 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364696 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364842 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.364984 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365163 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365292 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365470 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365596 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365772 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.365896 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366078 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366210 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366386 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366512 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366693 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.366890 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367023 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367147 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367312 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367446 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367620 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367759 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.367949 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368081 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368260 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368387 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368568 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368703 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.368886 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369011 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369196 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369322 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369505 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369643 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369813 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.369938 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.370645 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.370774 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.370983 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371116 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371298 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371430 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371608 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371734 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.371918 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372057 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372227 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372351 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372536 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372669 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372845 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.372970 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373156 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373281 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373464 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373592 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373792 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.373918 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374054 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374178 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374360 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374495 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374705 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374850 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.374974 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.375097 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.375289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.375549 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.375850 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.375984 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376183 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376322 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376499 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376641 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376815 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.376947 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377131 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377256 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377449 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377583 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377774 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.377899 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378099 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378224 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378403 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378537 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378717 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.378904 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379050 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379186 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379354 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379488 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379658 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379787 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.379960 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380087 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380264 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380397 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380564 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380698 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.380869 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381001 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381171 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381297 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381473 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381598 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381773 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.381898 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382074 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382198 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382380 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382507 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382679 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.382826 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383009 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383136 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383312 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383438 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383614 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383738 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.383925 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384049 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384228 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384362 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384529 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384654 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384862 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.384997 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.385158 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.385282 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.385442 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.385568 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.386287 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.386427 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.386628 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.386763 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.386988 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387116 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387383 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387514 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387631 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387757 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.387931 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388069 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388245 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388381 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388550 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388676 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388853 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.388978 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389159 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389293 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389464 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389598 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389767 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.389901 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390069 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390194 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390375 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390500 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390680 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.390825 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391012 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391146 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391316 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391444 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391618 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391749 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.391918 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392044 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392219 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392345 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392528 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392660 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392832 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.392965 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393136 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393260 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393440 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393580 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393746 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.393870 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394049 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394176 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394351 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394484 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394653 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.394900 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395033 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395155 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395279 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395415 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395575 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395709 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.395876 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396007 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396182 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396309 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396489 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396615 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396794 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.396921 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397102 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397234 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397418 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397543 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397725 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.397854 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398054 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398179 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398325 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398452 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398632 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398759 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.398961 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399088 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399269 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399397 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399583 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399718 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.399897 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400022 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400202 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400338 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400505 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400643 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400808 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.400934 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401110 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401235 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401438 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401578 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401742 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.401874 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402044 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402169 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402346 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402480 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402645 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402770 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.402974 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403099 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403277 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403404 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403579 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403703 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.403897 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404024 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404201 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404329 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404506 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404630 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404808 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.404948 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405146 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405272 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405439 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405565 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405742 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.405866 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406088 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406215 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406398 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406522 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406713 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.406877 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407049 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407177 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407362 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407486 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407671 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407805 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.407976 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408102 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408279 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408403 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408586 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408723 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.408898 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409022 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409200 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409318 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409502 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409637 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409801 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.409925 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410117 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410242 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410426 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410566 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410737 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.410890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411080 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411206 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411400 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411535 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411703 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.411837 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412011 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412136 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412319 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412445 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412626 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412752 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.412933 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413065 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413238 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413371 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413545 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413670 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413854 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.413987 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414164 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414291 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414472 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414598 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414811 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.414953 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415183 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415320 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415443 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415567 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415712 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.415857 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416012 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416138 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416315 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416447 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416631 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416766 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.416956 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417086 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417263 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417387 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417564 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417700 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417867 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.417999 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.418169 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.418303 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.418470 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.418596 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.418918 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419063 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419227 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419353 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419533 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419660 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419836 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.419961 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420143 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420268 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420452 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420578 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420763 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.420896 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421066 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421185 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421370 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421496 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421777 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.421914 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422087 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422223 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422396 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422520 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422697 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.422872 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423023 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423161 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423329 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423454 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423637 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423762 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.423940 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424079 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424242 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424370 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424545 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424676 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424851 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.424988 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425154 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425368 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425495 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425617 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425771 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.425899 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426168 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426293 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426472 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426598 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426822 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.426948 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427199 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427338 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427506 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427631 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427814 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.427947 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428133 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428260 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428454 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428578 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428759 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.428885 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429068 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429206 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429377 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429500 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429685 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.429811 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430007 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430133 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430317 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430444 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430626 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430760 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.430952 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431079 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431258 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431383 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431579 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.431890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.432024 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.432199 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.432325 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433033 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433175 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433442 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433569 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433754 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.433882 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434068 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434207 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434389 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434515 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434692 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.434867 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435006 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435131 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435319 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435522 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435649 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435773 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.435906 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436039 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436210 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436337 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436533 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436661 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436839 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.436967 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.437152 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.437286 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.437458 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.437833 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438037 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438164 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438287 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438418 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438602 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438737 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.438926 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439054 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439241 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439368 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439551 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439679 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439865 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.439990 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440182 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440308 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440487 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440623 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440793 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.440919 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441226 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441405 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441542 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441707 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.441833 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442007 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442132 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442311 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442437 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442634 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442761 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.442968 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443095 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443417 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443620 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443753 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.443930 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444057 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444243 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444369 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444572 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444698 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.444886 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445023 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445199 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445325 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445563 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445708 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445834 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.445966 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446091 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446215 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446395 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446523 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446696 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.446885 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447013 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447137 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447311 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447438 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447618 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447754 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.447918 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.448053 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.448762 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.448893 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449074 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449212 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449377 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449504 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449698 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449823 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.449999 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450127 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450311 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450445 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450614 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450740 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.450940 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451067 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451242 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451374 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451545 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451670 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451869 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.451995 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452178 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452303 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452499 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452632 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452815 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.452947 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453138 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453264 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453445 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453613 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453764 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.453898 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454078 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454203 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454393 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454526 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454705 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.454867 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455046 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455184 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455361 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455495 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455708 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455843 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.455977 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456101 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456276 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456404 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456586 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456711 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.456898 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.457031 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.457213 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.457346 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.457539 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.457728 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458055 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458190 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458370 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458511 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458683 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.458825 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459021 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459151 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459337 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459648 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459774 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.459959 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460083 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460268 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460395 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460580 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460699 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.460889 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461024 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461199 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461325 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461523 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461649 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461844 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.461979 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462172 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462308 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462484 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462610 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462817 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.462949 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463136 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463265 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463450 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463577 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463780 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.463910 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464129 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464255 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464435 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464745 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.464879 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465060 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465186 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465375 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465509 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465686 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.465894 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466030 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466154 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466441 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466609 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466737 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.466947 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467076 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467281 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467406 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467561 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467696 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.467872 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468040 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468179 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468310 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468497 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468634 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.468819 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469129 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469274 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469400 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469524 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469654 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.469910 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.470034 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.470244 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.470550 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.470678 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.470893 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471034 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471217 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471357 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471529 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471657 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471842 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.471978 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472156 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472282 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472478 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472613 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472783 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.472918 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473090 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473218 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473399 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473525 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473708 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.473835 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474014 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474149 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474319 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474444 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474633 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474759 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.474963 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475091 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475270 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475405 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475577 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475703 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.475876 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.476110 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.476412 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.476549 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.476757 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.476885 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477076 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477204 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477400 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477541 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477718 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.477853 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478026 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478155 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478334 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478475 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478645 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478772 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.478979 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.479118 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.479304 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.479944 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480104 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480232 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480409 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480537 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480716 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.480852 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481020 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481146 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481326 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481453 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481632 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481761 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.481936 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482061 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482237 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482364 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482542 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482678 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.482879 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483014 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483187 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483322 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483491 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483620 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483795 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.483921 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484096 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484230 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484400 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484528 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484705 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484872 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.484999 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485135 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485286 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485417 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485591 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485718 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.485895 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486029 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486197 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486323 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486501 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486626 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486820 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.486967 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487133 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487260 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487443 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487576 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487793 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.487934 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488097 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488222 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488403 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488529 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488711 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.488836 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489018 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489144 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489347 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489481 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489641 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489769 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.489951 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490077 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490266 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490393 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490593 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490720 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.490940 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.491151 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.491477 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.491614 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.491795 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.491913 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492121 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492246 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492448 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492583 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492758 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.492886 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493066 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493194 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493371 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493507 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493681 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493808 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.493991 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494124 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494301 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494443 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494610 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494735 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.494943 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.495110 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.495805 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.495932 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496118 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496253 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496429 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496557 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496741 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.496869 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497048 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497175 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497354 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497487 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497685 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497817 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.497941 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498064 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498249 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498387 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498556 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498688 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.498892 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499022 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499360 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499564 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499698 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499831 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.499964 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500149 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500278 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500461 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500597 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500771 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.500903 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501079 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501213 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501388 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501522 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501701 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.501827 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502019 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502147 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502330 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502456 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502637 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502766 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.502961 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.503085 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.503373 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.503500 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.503689 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.503817 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504007 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504134 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504317 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504444 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504627 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504762 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.504947 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505074 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505259 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505386 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505567 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505701 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.505875 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506001 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506190 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506315 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506520 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506660 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.506877 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507005 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507203 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507332 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507509 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507638 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507812 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.507978 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508103 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508227 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508407 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508536 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508715 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.508849 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509011 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509136 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509310 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509439 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509641 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509777 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.509902 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510062 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510190 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510314 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510497 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510650 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510843 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.510986 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511150 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511275 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511443 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511571 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511745 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.511880 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512048 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512182 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512349 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512475 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512650 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512790 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.512951 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513085 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513250 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513375 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513553 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513679 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513854 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.513979 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514155 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514281 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514584 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514758 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.514910 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515082 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515212 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515388 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515523 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515720 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.515855 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516034 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516159 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516353 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516487 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516664 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516790 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.516980 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517113 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517287 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517413 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517602 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517726 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.517920 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518097 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518238 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518365 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518528 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518662 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.518863 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519008 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519183 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519309 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519495 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519630 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519830 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.519965 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520090 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520214 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520402 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520529 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520711 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.520838 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521021 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521145 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521346 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521472 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521652 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521779 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.521962 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522282 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522408 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522600 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522726 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.522937 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523063 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523254 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523391 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523568 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523696 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.523901 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524029 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524213 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524354 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524525 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524654 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524842 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.524970 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525154 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525290 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525468 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525606 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525784 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.525911 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526111 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526237 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526449 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526575 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526761 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.526941 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527083 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527207 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527412 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527540 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527742 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.527878 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528055 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528182 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528396 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528524 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528724 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.528853 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529041 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529170 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529354 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529481 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529662 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.529812 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.530001 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103707) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 22:26:19.530129 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:26:19.530253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103706) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 22:26:19.587799 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO dbcounter [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Registered counter for database nova_api May 31 22:26:19.588121 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Registered counter for database nova_api May 31 22:26:19.608791 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_db.sqlalchemy.engines [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.612266 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.616125 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writer thread running {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.619573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.672596 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.context [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa724526-4fde-4fd6-8234-378dff7993fa(cell1) {{(pid=103707) load_cells /opt/stack/nova/nova/context.py:464}} May 31 22:26:19.675575 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.context [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa724526-4fde-4fd6-8234-378dff7993fa(cell1) {{(pid=103706) load_cells /opt/stack/nova/nova/context.py:464}} May 31 22:26:19.677983 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:26:19.679589 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:26:19.680104 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:26:19.680386 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:26:19.681657 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:26:19.682322 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:26:19.682447 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:26:19.684905 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO dbcounter [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Registered counter for database nova_cell0 May 31 22:26:19.685011 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_concurrency.lockutils [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103706) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:26:19.686964 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Registered counter for database nova_cell0 May 31 22:26:19.689136 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO dbcounter [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Registered counter for database nova_cell1 May 31 22:26:19.691391 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Registered counter for database nova_cell1 May 31 22:26:19.696218 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_db.sqlalchemy.engines [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.697949 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_db.sqlalchemy.engines [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.700216 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.702011 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.702444 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writer thread running {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.708433 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.709655 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.844845 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writer thread running {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.853367 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO dbcounter [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Registered counter for database nova_cell0 May 31 22:26:19.855494 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO dbcounter [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Registered counter for database nova_cell0 May 31 22:26:19.862133 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_db.sqlalchemy.engines [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103707) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.865674 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG oslo_db.sqlalchemy.engines [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103706) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:26:19.866453 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writer thread running {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:19.869925 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writer thread running {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:26:20.426377 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: WARNING keystonemiddleware.auth_token [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:26:20.433666 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: WARNING keystonemiddleware.auth_token [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:26:20.440660 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:26:20.447829 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:26:20.655167 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: WARNING keystonemiddleware.auth_token [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:26:20.661130 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: WARNING keystonemiddleware.auth_token [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:26:20.664941 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:26:20.666209 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a1c81c9c0 pid: 103707 (default app) May 31 22:26:20.668570 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:26:20.669745 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] 10.222.0.39 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001940 May 31 22:26:20.670159 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 788 bytes} [Tue May 31 22:26:20 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:26:20.670953 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: WARNING keystonemiddleware.auth_token [None req-f228de16-27d3-495d-8674-44bd28dd6bf8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:26:20.676124 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a1c81c9c0 pid: 103706 (default app) May 31 22:27:41.597641 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:41.599701 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002695 May 31 22:27:41.602517 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:41 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:41.613468 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:41.614580 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:41.615694 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell1:SELECT=3 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:41.616451 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:42.052128 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d5ced6d9-ffdb-425d-8a9a-0e370a819e82 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:42.085992 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d5ced6d9-ffdb-425d-8a9a-0e370a819e82 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.477735 May 31 22:27:42.086964 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 1/3] 10.222.0.39 () {60 vars in 1291 bytes} [Tue May 31 22:27:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:27:44.389118 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:44.390042 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-b35c04c1-b24e-437f-b596-856553b99518 None None] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 May 31 22:27:44.390604 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 3/4] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:44.453513 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ff03a794-7ac4-498c-9c96-6d66f33d0038 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "id": "c1", "vcpus": 1, "disk": 1}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:44.471763 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:27:44.471763 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: warnings.warn(msg) May 31 22:27:44.600484 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-ff03a794-7ac4-498c-9c96-6d66f33d0038 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.203986 May 31 22:27:44.606827 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 2/5] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:27:44.615951 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_api:SELECT=3 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:44.616693 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_cell1:SELECT=3 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:44.617438 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_cell0:SELECT=3 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:44.618154 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:27:44.823188 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-168d438d-3deb-41d3-bc45-789a61d4ad2e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:44.825604 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:27:44.825604 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:27:44.961638 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-168d438d-3deb-41d3-bc45-789a61d4ad2e admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.351574 May 31 22:27:44.969799 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 4/6] 10.222.0.39 () {64 vars in 1335 bytes} [Tue May 31 22:27:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:27:47.276876 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ff03a794-7ac4-498c-9c96-6d66f33d0038 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:47.277874 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-ff03a794-7ac4-498c-9c96-6d66f33d0038 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 May 31 22:27:47.278538 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 3/7] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:47.388673 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-231fd2f1-9381-4ee0-b98f-b7f5600821c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 5, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:47.406265 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:27:47.406265 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:27:47.507593 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-231fd2f1-9381-4ee0-b98f-b7f5600821c9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.223385 May 31 22:27:47.508884 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 5/8] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 22:27:47.521151 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-46e8abf6-c21c-48a7-8189-cb064dd8c5a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:47.522619 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:27:47.522619 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: warnings.warn(msg) May 31 22:27:47.647124 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-46e8abf6-c21c-48a7-8189-cb064dd8c5a2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.129728 May 31 22:27:47.647632 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 4/9] 10.222.0.39 () {64 vars in 1335 bytes} [Tue May 31 22:27:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:27:49.957087 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-231fd2f1-9381-4ee0-b98f-b7f5600821c9 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:49.958348 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-231fd2f1-9381-4ee0-b98f-b7f5600821c9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001706 May 31 22:27:49.959063 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:50.018807 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-86a48707-a922-4e90-b562-2f46be0061f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "vcpus": 1, "disk": 10, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 1024, "os-flavor-access:is_public": true}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:50.105733 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-86a48707-a922-4e90-b562-2f46be0061f9 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140345 May 31 22:27:50.113344 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 5/11] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 22:27:50.119075 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-a1a79635-996c-4048-8725-377f83a7fe2a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:50.238678 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-a1a79635-996c-4048-8725-377f83a7fe2a admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.123470 May 31 22:27:50.239564 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 7/12] 10.222.0.39 () {64 vars in 1335 bytes} [Tue May 31 22:27:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:27:52.542920 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-86a48707-a922-4e90-b562-2f46be0061f9 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:52.543931 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-86a48707-a922-4e90-b562-2f46be0061f9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 31 22:27:52.544527 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 6/13] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:27:52.603748 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-efa7da08-937d-4830-bc70-4857cb00914f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:52.700009 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-efa7da08-937d-4830-bc70-4857cb00914f admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149910 May 31 22:27:52.700599 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 8/14] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:27:52.712604 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-6e6b3e09-0be1-4468-8671-1d75c93194e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:52.800575 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-6e6b3e09-0be1-4468-8671-1d75c93194e0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091538 May 31 22:27:52.801247 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 7/15] 10.222.0.39 () {64 vars in 1335 bytes} [Tue May 31 22:27:52 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:27:55.092273 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-efa7da08-937d-4830-bc70-4857cb00914f admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:55.093278 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-efa7da08-937d-4830-bc70-4857cb00914f admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 31 22:27:55.093917 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 9/16] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:55.151323 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "ram": 4096}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:55.207695 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.108262 May 31 22:27:55.208332 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 8/17] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:27:55.220733 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-a1662b99-6d0e-426e-91b2-aa4d3a5ac76b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:27:55.290583 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-a1662b99-6d0e-426e-91b2-aa4d3a5ac76b admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073364 May 31 22:27:55.291412 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 10/18] 10.222.0.39 () {64 vars in 1335 bytes} [Tue May 31 22:27:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:27:57.579723 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:57.585436 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001653 May 31 22:27:57.585436 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 9/19] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:27:57.640929 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-b28af0fc-af52-4666-8e25-6743c03fed90 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:57.665280 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-b28af0fc-af52-4666-8e25-6743c03fed90 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.077746 May 31 22:27:57.665833 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 11/20] 10.222.0.39 () {60 vars in 1291 bytes} [Tue May 31 22:27:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:27:59.976579 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:27:59.977528 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-036e779f-7673-4466-9393-a646e499c983 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 31 22:27:59.977946 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 10/21] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:00.037039 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-5391e642-0293-4430-923f-017943c4c476 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "1", "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "ram": 512, "disk": 1}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:00.122280 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-5391e642-0293-4430-923f-017943c4c476 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.138202 May 31 22:28:00.122923 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 12/22] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:27:59 2022] POST /compute/v2.1/flavors => generated 402 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:00.138019 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-c855c265-60db-4b98-b96c-decce3b8f577 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:00.205988 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-c855c265-60db-4b98-b96c-decce3b8f577 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073256 May 31 22:28:00.206617 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 11/23] 10.222.0.39 () {64 vars in 1332 bytes} [Tue May 31 22:28:00 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:28:03.352548 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-5391e642-0293-4430-923f-017943c4c476 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:03.354342 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-5391e642-0293-4430-923f-017943c4c476 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001692 May 31 22:28:03.354920 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 13/24] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:28:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:03.419671 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-70ac3fe4-7dd3-4b15-b616-0f84c33767be admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "disk": 20, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:03.483398 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-70ac3fe4-7dd3-4b15-b616-0f84c33767be admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.121869 May 31 22:28:03.483978 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 12/25] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:28:03 2022] POST /compute/v2.1/flavors => generated 405 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 22:28:03.497592 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-a883332e-7d74-4aae-821b-eb67eb05d2aa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:03.595158 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-a883332e-7d74-4aae-821b-eb67eb05d2aa admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101850 May 31 22:28:03.595672 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 14/26] 10.222.0.39 () {64 vars in 1332 bytes} [Tue May 31 22:28:03 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:28:05.985641 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-70ac3fe4-7dd3-4b15-b616-0f84c33767be admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:05.986665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-70ac3fe4-7dd3-4b15-b616-0f84c33767be admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 May 31 22:28:05.987163 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 13/27] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:06.045425 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-0218c796-c93f-4304-bcfc-2290fce8af94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:06.115996 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-0218c796-c93f-4304-bcfc-2290fce8af94 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.122998 May 31 22:28:06.116545 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 15/28] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:28:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:06.128072 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8921cdc7-9703-4a1c-8985-1302667106b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:06.222769 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8921cdc7-9703-4a1c-8985-1302667106b8 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098182 May 31 22:28:06.223382 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 14/29] 10.222.0.39 () {64 vars in 1332 bytes} [Tue May 31 22:28:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:28:08.506876 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-0218c796-c93f-4304-bcfc-2290fce8af94 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:08.508084 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-0218c796-c93f-4304-bcfc-2290fce8af94 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001667 May 31 22:28:08.508647 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 16/30] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:28:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:08.570083 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-559396dc-b63a-4e05-ab23-975d4f271adb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:08.660650 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-559396dc-b63a-4e05-ab23-975d4f271adb admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.146140 May 31 22:28:08.661597 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 15/31] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:28:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:08.674761 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-f5796ed4-512e-4bec-a5d0-f06804fe1944 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:08.760279 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-f5796ed4-512e-4bec-a5d0-f06804fe1944 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089406 May 31 22:28:08.761325 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 17/32] 10.222.0.39 () {64 vars in 1332 bytes} [Tue May 31 22:28:08 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:28:11.084060 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-559396dc-b63a-4e05-ab23-975d4f271adb admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:11.085081 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-559396dc-b63a-4e05-ab23-975d4f271adb admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 31 22:28:11.085488 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 16/33] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:28:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:11.151216 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:11.254108 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.162040 May 31 22:28:11.255341 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 18/34] 10.222.0.39 () {64 vars in 1282 bytes} [Tue May 31 22:28:11 2022] POST /compute/v2.1/flavors => generated 408 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 22:28:11.267291 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-117e5c57-6241-479c-aabd-519c96627532 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:11.337636 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-117e5c57-6241-479c-aabd-519c96627532 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.074023 May 31 22:28:11.338903 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 17/35] 10.222.0.39 () {64 vars in 1332 bytes} [Tue May 31 22:28:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:28:34.739953 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:34.740996 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 31 22:28:34.741398 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 19/36] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:28:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:34.748507 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:28:34.799277 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-0bd38a64-c9f1-4a7d-a692-936be8cae2c5 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:34.816743 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-0bd38a64-c9f1-4a7d-a692-936be8cae2c5 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069207 May 31 22:28:34.820704 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 18/37] 10.222.0.39 () {60 vars in 1291 bytes} [Tue May 31 22:28:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:28:35.795922 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:35.796917 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-602a1e5f-4ff5-4e22-8d19-cc8b2917bffc admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 May 31 22:28:35.797319 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 20/38] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:35.998664 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8f10e7a7-cbe7-4576-ac0c-3e525e8577b1 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:36.004340 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-8f10e7a7-cbe7-4576-ac0c-3e525e8577b1 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8f10e7a7-cbe7-4576-ac0c-3e525e8577b1 admin admin] Request method failure captured: May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept: application/json May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.39 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABilpaTZI7E93P55dsaiZ9aZTBxKljZ9WaG37uZFbjgKTrIvxIKAYmRxO5ovBxDzNiDPSwFNsb_umEZm-TmPVASBXd1aaZNHd_PRpoBnf750rZi4HXmGfCXfDnH99G3uf2M9UjarS2ajAmnB-a7eUvoyv_RjitqmwcWzDiy3nLJ5M6x-R4 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Role: admin,reader,member May 31 22:28:36.007588 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Roles: admin,reader,member May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User: admin May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: method: > May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: exception: Flavor 42 could not be found. May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '42'} May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:36.009253 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:36.010299 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:36.011717 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8f10e7a7-cbe7-4576-ac0c-3e525e8577b1 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:36.013039 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8f10e7a7-cbe7-4576-ac0c-3e525e8577b1 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061611 May 31 22:28:36.013039 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 19/39] 10.222.0.39 () {60 vars in 1190 bytes} [Tue May 31 22:28:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 22:28:36.018650 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-a22a6da7-13de-4ce2-957f-982ffcee4f58 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:36.021580 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:28:36.040032 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-a22a6da7-13de-4ce2-957f-982ffcee4f58 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024926 May 31 22:28:36.040564 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 21/40] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:28:36.065194 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-28f6e25a-7f94-411a-a58a-4d522cf2a159 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:36.085867 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-28f6e25a-7f94-411a-a58a-4d522cf2a159 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024482 May 31 22:28:36.086379 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:28:36.095397 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-c3cf51a9-39e3-49c2-b45c-762c90edb032 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:36.101241 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.wsgi [None req-c3cf51a9-39e3-49c2-b45c-762c90edb032 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-c3cf51a9-39e3-49c2-b45c-762c90edb032 admin admin] Request method failure captured: May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept: application/json May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept-Encoding: gzip, deflate May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Connection: keep-alive May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Content-Length: 0 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Host: 10.222.0.39 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-Api-Version: compute 2.90 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-System-Scope: None May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: User-Agent: python-novaclient May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Auth-Token: gAAAAABilpaTZI7E93P55dsaiZ9aZTBxKljZ9WaG37uZFbjgKTrIvxIKAYmRxO5ovBxDzNiDPSwFNsb_umEZm-TmPVASBXd1aaZNHd_PRpoBnf750rZi4HXmGfCXfDnH99G3uf2M9UjarS2ajAmnB-a7eUvoyv_RjitqmwcWzDiy3nLJ5M6x-R4 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Id: None May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Name: None May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Identity-Status: Confirmed May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Is-Admin-Project: True May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Id: default May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Name: Default May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Name: admin May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Role: admin,reader,member May 31 22:28:36.105086 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Roles: admin,reader,member May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant: admin May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Name: admin May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User: admin May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Id: default May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Name: Default May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Name: admin May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: method: > May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: exception: Flavor 42 could not be found. May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: action_args: {'id': '42'} May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:36.110989 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:36.111779 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:36.112837 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-c3cf51a9-39e3-49c2-b45c-762c90edb032 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:36.113961 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-c3cf51a9-39e3-49c2-b45c-762c90edb032 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014591 May 31 22:28:36.113961 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 22/42] 10.222.0.39 () {60 vars in 1190 bytes} [Tue May 31 22:28:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 31 22:28:36.964583 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-28f6e25a-7f94-411a-a58a-4d522cf2a159 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:36.965641 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-28f6e25a-7f94-411a-a58a-4d522cf2a159 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 May 31 22:28:36.965991 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 21/43] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:37.152744 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-239e8b64-55d1-4a33-86b3-f07b3d9a83de admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:37.157875 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.wsgi [None req-239e8b64-55d1-4a33-86b3-f07b3d9a83de admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-239e8b64-55d1-4a33-86b3-f07b3d9a83de admin admin] Request method failure captured: May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept: application/json May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept-Encoding: gzip, deflate May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Connection: keep-alive May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Content-Length: 0 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Host: 10.222.0.39 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-Api-Version: compute 2.90 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-System-Scope: None May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: User-Agent: python-novaclient May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Auth-Token: gAAAAABilpaUj4Ca06tuRSCx5zBylV6vXTpyM2X1uHzjzFTG2KjI0mY75K4EKEsFqPxobIFmfJJbPeApvbp1U1b567wRjOwJNg2FmnkV2GG8KE8IbBLJ9HXffhhBJ1BR5CzIaWqO9ej8dKq32dNIfhF9h1swwUYuFEM4wtkgwhucJrZOL_yGJQ8 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Id: None May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Name: None May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Identity-Status: Confirmed May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Is-Admin-Project: True May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Id: default May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Name: Default May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Name: admin May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Role: admin,reader,member May 31 22:28:37.162890 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Roles: admin,reader,member May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant: admin May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Name: admin May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User: admin May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Id: default May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Name: Default May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Name: admin May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: method: > May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: exception: Flavor 84 could not be found. May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: action_args: {'id': '84'} May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:37.164225 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:37.165101 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:37.166199 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-239e8b64-55d1-4a33-86b3-f07b3d9a83de admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:37.167481 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-239e8b64-55d1-4a33-86b3-f07b3d9a83de admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059940 May 31 22:28:37.167481 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 23/44] 10.222.0.39 () {60 vars in 1190 bytes} [Tue May 31 22:28:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 22:28:37.170464 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-869c6bea-9c54-4b09-befd-9b87ee37573d admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:37.184329 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-869c6bea-9c54-4b09-befd-9b87ee37573d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017376 May 31 22:28:37.184840 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:28:37.194010 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-eca3fd8d-e2af-4744-a6c7-510e21b88be9 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:37.208218 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-eca3fd8d-e2af-4744-a6c7-510e21b88be9 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017603 May 31 22:28:37.208733 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:28:37.217688 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ae082a09-5e10-4bb9-9bf0-4a8f81504615 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:37.222802 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-ae082a09-5e10-4bb9-9bf0-4a8f81504615 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ae082a09-5e10-4bb9-9bf0-4a8f81504615 admin admin] Request method failure captured: May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept: application/json May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.39 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABilpaUj4Ca06tuRSCx5zBylV6vXTpyM2X1uHzjzFTG2KjI0mY75K4EKEsFqPxobIFmfJJbPeApvbp1U1b567wRjOwJNg2FmnkV2GG8KE8IbBLJ9HXffhhBJ1BR5CzIaWqO9ej8dKq32dNIfhF9h1swwUYuFEM4wtkgwhucJrZOL_yGJQ8 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Role: admin,reader,member May 31 22:28:37.224282 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Roles: admin,reader,member May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User: admin May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: method: > May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: exception: Flavor 84 could not be found. May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '84'} May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:37.225783 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:37.226633 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:37.227748 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-ae082a09-5e10-4bb9-9bf0-4a8f81504615 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:37.228896 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-ae082a09-5e10-4bb9-9bf0-4a8f81504615 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011363 May 31 22:28:37.228896 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 23/47] 10.222.0.39 () {60 vars in 1190 bytes} [Tue May 31 22:28:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 22:28:38.083021 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-eca3fd8d-e2af-4744-a6c7-510e21b88be9 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:38.084061 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-eca3fd8d-e2af-4744-a6c7-510e21b88be9 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 May 31 22:28:38.084458 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 25/48] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:38.269894 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-46e3ed18-4c38-4c64-971a-3e5e62a79d62 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:38.276181 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.wsgi [None req-46e3ed18-4c38-4c64-971a-3e5e62a79d62 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-46e3ed18-4c38-4c64-971a-3e5e62a79d62 admin admin] Request method failure captured: May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept: application/json May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Accept-Encoding: gzip, deflate May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Connection: keep-alive May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Content-Length: 0 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Host: 10.222.0.39 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-Api-Version: compute 2.90 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Openstack-System-Scope: None May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: User-Agent: python-novaclient May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Auth-Token: gAAAAABilpaWUUDDYPH2VzEQ5DuMG9KcmR27pKqHJU5Qc5W3Cyffl58vOd2Ck__t8GUm-chfibrLHRDpUkPA5TGHUmTWlcDx8J7AuOKDbrCN-LSqpfk1i-vqrBpjYeHApM4LOM736zL-5oT8zrlbpkIfin_Rp3_32EIgJ7YtedsxuOghRY4IMNI May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Id: None May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Domain-Name: None May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Identity-Status: Confirmed May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Is-Admin-Project: True May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Id: default May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Domain-Name: Default May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Project-Name: admin May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Role: admin,reader,member May 31 22:28:38.277665 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Roles: admin,reader,member May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant: admin May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-Tenant-Name: admin May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User: admin May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Id: default May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Domain-Name: Default May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: X-User-Name: admin May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: method: > May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: exception: Flavor 451 could not be found. May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: action_args: {'id': '451'} May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:38.279274 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:38.280289 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: ERROR nova.api.openstack.wsgi May 31 22:28:38.281573 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-46e3ed18-4c38-4c64-971a-3e5e62a79d62 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103706) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:38.282899 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-46e3ed18-4c38-4c64-971a-3e5e62a79d62 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058501 May 31 22:28:38.282899 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 24/49] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:28:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 31 22:28:38.288628 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-806b546f-b407-4ba9-8176-48c1f298b4cd admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:38.302041 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-806b546f-b407-4ba9-8176-48c1f298b4cd admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016932 May 31 22:28:38.302498 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 26/50] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:28:38.311921 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:38.325714 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017446 May 31 22:28:38.326231 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 25/51] 10.222.0.39 () {60 vars in 1210 bytes} [Tue May 31 22:28:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:28:38.335197 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-3a0ffc9d-a8ac-467c-84b8-135b3da793cf admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:38.340995 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.wsgi [None req-3a0ffc9d-a8ac-467c-84b8-135b3da793cf admin admin] HTTP exception thrown: Flavor 451 could not be found. May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-3a0ffc9d-a8ac-467c-84b8-135b3da793cf admin admin] Request method failure captured: May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept: application/json May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Accept-Encoding: gzip, deflate May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Connection: keep-alive May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Content-Length: 0 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Host: 10.222.0.39 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-Api-Version: compute 2.90 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Openstack-System-Scope: None May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: User-Agent: python-novaclient May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Auth-Token: gAAAAABilpaWUUDDYPH2VzEQ5DuMG9KcmR27pKqHJU5Qc5W3Cyffl58vOd2Ck__t8GUm-chfibrLHRDpUkPA5TGHUmTWlcDx8J7AuOKDbrCN-LSqpfk1i-vqrBpjYeHApM4LOM736zL-5oT8zrlbpkIfin_Rp3_32EIgJ7YtedsxuOghRY4IMNI May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Id: None May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Domain-Name: None May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Identity-Status: Confirmed May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Is-Admin-Project: True May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Openstack-Nova-Api-Version: 2.90 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Id: default May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Domain-Name: Default May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Project-Name: admin May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Role: admin,reader,member May 31 22:28:38.342466 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Roles: admin,reader,member May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/19b11177cf71440f987ebfd0aebee320"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_19b11177cf71440f987ebfd0aebee320"}]}] May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant: admin May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Id: 19b11177cf71440f987ebfd0aebee320 May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-Tenant-Name: admin May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User: admin May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Id: default May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Domain-Name: Default May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Id: ba4882b1d1ec40428cfb5aa284a2e32b May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: X-User-Name: admin May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: method: > May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: exception: Flavor 451 could not be found. May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: action_args: {'id': '451'} May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:28:38.344100 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:38.345173 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: ERROR nova.api.openstack.wsgi May 31 22:28:38.346457 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-3a0ffc9d-a8ac-467c-84b8-135b3da793cf admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103707) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:28:38.347710 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-3a0ffc9d-a8ac-467c-84b8-135b3da793cf admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012162 May 31 22:28:38.347710 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 27/52] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:28:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 31 22:28:39.208259 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:39.209261 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 May 31 22:28:39.209660 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 26/53] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:28:39.396497 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-e785594b-66bb-4e71-a1bd-af77ef403db6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:39.515865 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-e785594b-66bb-4e71-a1bd-af77ef403db6 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.169511 May 31 22:28:39.516458 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 28/54] 10.222.0.39 () {64 vars in 1235 bytes} [Tue May 31 22:28:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:40.381190 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:40.382191 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 May 31 22:28:40.382593 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 27/55] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:40.570866 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-d0fb22d1-7357-4c4c-8ffa-326a6d5880d0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:40.657599 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-d0fb22d1-7357-4c4c-8ffa-326a6d5880d0 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.138198 May 31 22:28:40.658108 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 29/56] 10.222.0.39 () {64 vars in 1235 bytes} [Tue May 31 22:28:40 2022] POST /compute/v2.1/flavors => generated 405 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:41.510639 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:41.511667 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 May 31 22:28:41.512062 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 28/57] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:41.699051 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-2bb5f4c0-ab63-4260-883c-fac1b957daa2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:41.771095 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-2bb5f4c0-ab63-4260-883c-fac1b957daa2 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.124680 May 31 22:28:41.771585 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 30/58] 10.222.0.39 () {64 vars in 1235 bytes} [Tue May 31 22:28:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:42.636598 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:42.637590 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 31 22:28:42.637985 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 29/59] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:42.822290 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-e51a8dad-c9d2-472e-a9ce-7bbf772979c1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:28:42.937742 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-e51a8dad-c9d2-472e-a9ce-7bbf772979c1 admin admin] 10.222.0.39 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.166273 May 31 22:28:42.938224 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 31/60] 10.222.0.39 () {64 vars in 1235 bytes} [Tue May 31 22:28:42 2022] POST /compute/v2.1/flavors => generated 409 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:28:43.797239 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:43.798241 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 31 22:28:43.798640 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:28:43.984093 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-659d50cc-ec69-4e8d-ba30-9c598c65cd9c admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:28:44.003418 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-659d50cc-ec69-4e8d-ba30-9c598c65cd9c admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068991 May 31 22:28:44.003943 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 32/62] 10.222.0.39 () {60 vars in 1202 bytes} [Tue May 31 22:28:43 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:29:44.516737 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.517729 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-8b680856-e246-4b3e-9a7f-a1d6faa07601 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001397 May 31 22:29:44.518120 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 31/63] 10.222.0.39 () {54 vars in 930 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:29:44.525832 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:29:44.576699 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-951d4e7f-f319-4439-81c8-925147534cc4 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.596125 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-951d4e7f-f319-4439-81c8-925147534cc4 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072328 May 31 22:29:44.596664 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 33/64] 10.222.0.39 () {60 vars in 1291 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:29:44.617135 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG dbcounter [-] [103706] Writing DB stats nova_api:SELECT=14 {{(pid=103706) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:29:44.621374 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-d0b99cff-56a9-4908-86a0-aae44616515d admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.628914 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-d0b99cff-56a9-4908-86a0-aae44616515d admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013332 May 31 22:29:44.629427 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 32/65] 10.222.0.39 () {60 vars in 1282 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:29:44.641419 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-2c12530b-4069-4a00-8c91-db474b4da19f admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.649004 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-2c12530b-4069-4a00-8c91-db474b4da19f admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011406 May 31 22:29:44.654032 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 34/66] 10.222.0.39 () {60 vars in 1285 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:29:44.660707 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.668397 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011447 May 31 22:29:44.668910 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 33/67] 10.222.0.39 () {60 vars in 1285 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:29:44.679659 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-48ebf807-f02c-4e3d-bf1b-ca3e8edb5a3b admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:29:44.687860 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-48ebf807-f02c-4e3d-bf1b-ca3e8edb5a3b admin admin] 10.222.0.39 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011615 May 31 22:29:44.688383 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 35/68] 10.222.0.39 () {60 vars in 1282 bytes} [Tue May 31 22:29:44 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:33:22.790186 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:22.791784 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002010 May 31 22:33:22.792172 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 34/69] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:33:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:33:22.944236 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_api:SELECT=6 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:33:23.057169 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:23.058593 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:33:23.058593 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:33:23.059808 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:23.060278 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:23.061052 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:23.061474 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:23.095099 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-ed75ffe7-a0a4-4a7e-82dd-5b9bc6788b90 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.152217 May 31 22:33:23.095645 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 36/70] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:33:22 2022] GET /compute/v2.1/os-services => generated 791 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:33:23.966270 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:23.967242 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 May 31 22:33:23.967643 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:33:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:33:24.169708 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:24.171024 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:33:24.171024 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:33:24.172237 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:24.172675 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:24.173582 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:24.174025 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:24.195002 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-f4f3e63d-12ef-4137-9078-79bb08985f03 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.086548 May 31 22:33:24.195570 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 37/72] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:33:24 2022] GET /compute/v2.1/os-services => generated 791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:33:35.484963 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:35.486678 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002234 May 31 22:33:35.487428 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 36/73] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:33:35 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:33:35.630255 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_cell0:SELECT=4 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:33:35.631013 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_cell1:SELECT=4 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:33:35.631634 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG dbcounter [-] [103707] Writing DB stats nova_api:SELECT=8 {{(pid=103707) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:33:35.678476 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:35.679691 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:33:35.679691 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:33:35.680900 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:35.681336 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:35.682177 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:35.682601 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:35.708174 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-4cfcd824-3356-43ba-a395-a089732e7a92 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082222 May 31 22:33:35.708654 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 38/74] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:33:35 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:33:36.580238 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: DEBUG nova.api.openstack.wsgi [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] Calling method '>' {{(pid=103706) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:36.581230 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: INFO nova.api.openstack.requestlog [None req-3d738755-3b10-45a3-b63a-fbbbe6a39c37 admin admin] 10.222.0.39 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 31 22:33:36.581658 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: [pid: 103706|app: 0|req: 37/75] 10.222.0.39 () {56 vars in 1074 bytes} [Tue May 31 22:33:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:33:36.769198 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG nova.api.openstack.wsgi [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] Calling method '>' {{(pid=103707) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:33:36.770381 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 31 22:33:36.770381 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: warnings.warn(msg) May 31 22:33:36.771575 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:36.772018 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:36.772789 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:33:36.773213 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: DEBUG oslo_concurrency.lockutils [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103707) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:33:36.795120 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: INFO nova.api.openstack.requestlog [None req-8ded028a-5d8e-423d-990a-a301d0b6c3f6 admin admin] 10.222.0.39 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.075684 May 31 22:33:36.795601 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: [pid: 103707|app: 0|req: 39/76] 10.222.0.39 () {60 vars in 1193 bytes} [Tue May 31 22:33:36 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:34:34.956740 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: Tue May 31 22:34:34 2022 - graceful shutdown triggered... May 31 22:34:34.956299 dv-cinder-844140-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 31 22:34:34.957718 dv-cinder-844140-1-iscsi devstack@n-api.service[103706]: Gracefully killing worker 1 (pid: 103706)... May 31 22:34:34.958077 dv-cinder-844140-1-iscsi devstack@n-api.service[103707]: Gracefully killing worker 2 (pid: 103707)... May 31 22:34:35.957405 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: worker 1 buried after 1 seconds May 31 22:34:35.957405 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: worker 2 buried after 1 seconds May 31 22:34:35.957405 dv-cinder-844140-1-iscsi devstack@n-api.service[103705]: goodbye to uWSGI. May 31 22:34:35.958941 dv-cinder-844140-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 31 22:34:35.959501 dv-cinder-844140-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 31 22:34:35.962771 dv-cinder-844140-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 31 22:34:35.980525 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue May 31 22:34:35 2022] *** May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: nodename: dv-cinder-844140-1-iscsi May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: machine: x86_64 May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: clock source: unix May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: pcre jit disabled May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: detected number of CPU cores: 4 May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: current working directory: / May 31 22:34:36.007643 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: detected binary path: /usr/bin/uwsgi-core May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: your processes number limit is 47680 May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: your memory page size is 4096 bytes May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: detected max file descriptor number: 2048 May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: lock engine: pthread robust mutexes May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: thunder lock: enabled May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 31 22:34:36.009032 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 31 22:34:36.053600 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: Python main interpreter initialized at 0x55abd798b9c0 May 31 22:34:36.053600 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: python threads support enabled May 31 22:34:36.053600 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: your server socket listen backlog is limited to 100 connections May 31 22:34:36.053600 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: your mercy for graceful operations on workers is 90 seconds May 31 22:34:36.054066 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: mapped 403077 bytes (393 KB) for 2 cores May 31 22:34:36.054066 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: *** Operational MODE: preforking *** May 31 22:34:36.054282 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: *** uWSGI is running in multiple interpreter mode *** May 31 22:34:36.054282 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: spawned uWSGI master process (pid: 124575) May 31 22:34:36.054486 dv-cinder-844140-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 31 22:34:36.055130 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: spawned uWSGI worker 1 (pid: 124589, cores: 1) May 31 22:34:36.055983 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: spawned uWSGI worker 2 (pid: 124590, cores: 1) May 31 22:34:36.055983 dv-cinder-844140-1-iscsi devstack@n-api.service[124575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 31 22:34:37.282352 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 22:34:37.283440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 31 22:34:38.106281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:34:38.106281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: from cryptography.utils import int_from_bytes May 31 22:34:38.106613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:34:38.106613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: from cryptography.utils import int_from_bytes May 31 22:34:38.108980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:34:38.108980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: from cryptography.utils import int_from_bytes May 31 22:34:38.109318 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 31 22:34:38.109318 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: from cryptography.utils import int_from_bytes May 31 22:34:40.528497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 22:34:40.529151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 22:34:40.529442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 22:34:40.529653 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 22:34:40.529920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 22:34:40.530315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.530648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.531004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.531335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.532121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.532121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.532281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.532618 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.532952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.533221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.533740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.533919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-1-iscsi {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.534237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.534571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.534925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.535259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.535574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.535908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.536223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.536737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.538091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.538091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.538091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.538471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.538594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 31 22:34:40.539508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.539601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 31 22:34:40.539707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.539965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 31 22:34:40.540190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.540412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 31 22:34:40.540638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.540858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 31 22:34:40.541108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.541345 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.541562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.541777 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.541995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-1-iscsi {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.542214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.542441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.542653 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.542918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.543145 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.543369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.543612 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.543828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.544035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.544254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.544479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.544695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.544913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.545108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.545330 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.545330 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.545668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.545821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-844140-1-iscsi {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.546873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547708 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.547891 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.548796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.548796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.548996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549102 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549288 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.549922 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550018 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550490 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.550921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-844140-1-iscsi {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551278 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.551912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552079 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552178 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552620 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.552947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553259 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.553916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.554154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.554256 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.554476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.554576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.555388 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.555495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.555703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.555809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556339 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556446 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556650 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.556958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.557057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.557212 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.557572 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.557778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.557877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.558105 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.558390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.558559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.558676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559557 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.559882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.560978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561082 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561293 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561622 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.561937 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562042 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.562897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.563949 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.39 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.39 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.564881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565500 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.565815 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566460 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.566772 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567323 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.567967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.568068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.568766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.568904 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569291 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.569940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570138 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.570866 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571407 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.571823 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.572995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573126 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573615 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.573997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574139 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574265 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574517 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574630 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.574981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575306 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.575917 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577514 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.577913 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578000 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578092 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578185 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578278 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.578903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.578987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.579072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.579165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.579424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.579516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.579677 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.579776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.580006 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.580146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.580358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.580517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.580669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.580762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.580991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.581089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.581301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.581461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.581590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.581710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.581900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.582020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.582204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.582308 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.582524 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.582617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.582866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.582975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.583182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.583282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.583494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.583587 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.583803 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.583903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.584125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 31 22:34:40.584226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.584463 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.584563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.584799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.584898 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.585899 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586160 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.586922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587138 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587467 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587569 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587777 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.587877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.588836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589141 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589672 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.589988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590814 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.590969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591299 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.591937 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592272 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592373 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.592908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593848 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.593940 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594568 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.594914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595444 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.595856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596075 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.596792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.597947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598261 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598679 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.598908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.599951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600650 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.600915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.601061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.601163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.601368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.601465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.602218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.602322 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.602547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.602647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.602895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603571 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.603986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604607 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.604914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605245 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605444 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.605845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.606792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607421 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607749 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.607949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608264 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.608926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609521 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609681 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.609920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610231 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610422 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610670 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.610994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.611090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.611343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.611454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.611674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.611775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612000 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612092 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.612926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613027 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613231 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.613938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614550 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.614893 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615240 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.615821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616345 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616445 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.616955 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.617049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.617836 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.617950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618491 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618850 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.618960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619584 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.619897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620439 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620786 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.620935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.621949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.622107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.622291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.622604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.622745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.622991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623613 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623754 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.623902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624354 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.624883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.625826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.626143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.626419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.626580 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.626752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.626915 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627516 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.627831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628000 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628319 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628634 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.628953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.629902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.630059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.630198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.630357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.630513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.630693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631614 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631701 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.631885 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.632808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633432 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.633969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.634923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.635950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636164 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636801 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.636902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637435 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.637855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638681 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.638791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.639938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.640889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641136 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.641824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642429 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.642892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.643829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644026 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644337 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.644961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645596 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.645908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646219 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646314 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646524 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646627 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.646971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.647176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.647270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.647495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.647739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.647834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.648072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.648175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.648934 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.649914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.650840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651464 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.651859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652153 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652468 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652681 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.652989 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653084 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.653908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654306 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654519 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654846 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.654957 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655572 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.655878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656511 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656719 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.656822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.657937 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658045 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658570 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.658916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659550 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.659951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660264 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.660890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661566 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661708 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.661803 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662109 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.662963 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663068 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663277 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663582 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.663989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.664746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.664858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665681 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.665987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.666931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.667958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668777 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.668881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669086 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669697 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.669790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670318 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.670965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671076 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671592 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.671904 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672215 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.672957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.673887 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.674820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.675947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.676909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677119 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677211 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677422 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.677826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678158 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678698 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.678820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679046 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679698 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.679802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.680733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.681486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.681647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.681744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.681831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.681916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682801 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.682910 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683452 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683767 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.683989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684404 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.684928 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.685958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.686948 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687114 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687267 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687428 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.687899 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688353 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.688957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689277 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689670 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689888 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.689981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690838 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.690945 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691151 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691461 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.691881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692205 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.692821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693463 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.693784 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694117 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694319 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.694837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695506 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.695810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.696960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697061 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697266 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697875 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.697995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.698195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.698326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.698501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.698641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.698905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699736 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.699926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.700949 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701436 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.701992 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.702328 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.702448 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.702806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.702959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.702959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.703292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.703413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.703619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.703753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.703984 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704330 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.704997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.705240 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.705450 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.705551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.705785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.705900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706442 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.706902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707779 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.707883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708449 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.708859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709168 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709691 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.709993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.710094 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.710326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.710434 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.710636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.710736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.711625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712140 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712567 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.712713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.713695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714185 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.714952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.715115 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.715277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716174 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716785 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.716936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717524 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717693 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.717848 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.718931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719082 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719675 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.719970 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720436 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.720933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721299 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.721865 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722469 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.722855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723548 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.723825 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724150 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724748 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.724960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725615 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.725950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.726173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.726275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.726528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.727181 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.727404 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.727510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.727732 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.727829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.728794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729338 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.729971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730392 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730606 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.730948 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731267 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731377 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.731999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732436 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.732989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733448 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.733956 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.734940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735258 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735360 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.735900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736860 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.736964 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737597 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737813 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.737914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.738903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.739125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.739220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.739445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.739659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.739763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.740996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741097 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741309 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741623 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.741940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.742957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743068 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.743914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.744041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.744232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.744434 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.744753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.745073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.745412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.745663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.745764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746451 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746680 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.746941 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.747943 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748563 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.748989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.749922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.750140 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.750241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.750516 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.750679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.750859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.751831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.752998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753298 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753614 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.753916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754846 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.754992 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.755878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756408 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756735 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.756837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757042 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757771 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.757998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758100 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758309 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.758948 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759258 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.759976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.760916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.761127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.761220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.761440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.761758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.761854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762773 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.762895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.763809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764349 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.764803 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765356 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.765989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.766221 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.766324 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.766559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.766654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.766919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767332 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.767962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768803 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.768895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.769839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.770812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771028 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771339 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771754 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.771967 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772428 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772818 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.772955 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.773066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.773329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.773942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.774950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775139 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.775869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776736 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.776831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777467 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.777820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778065 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778161 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.778876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779450 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779785 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.779993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.780934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781249 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781343 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.781977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.782189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.782304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.782502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.782622 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.782814 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783735 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.783829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784040 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784132 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784478 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784659 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.784965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785590 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.785997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.786979 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787176 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787576 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787790 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.787892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.788818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.789035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.789634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.789934 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790245 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.790913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791238 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.791985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.792899 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793542 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.793867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794174 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.794860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795178 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.795842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796050 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.796783 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797637 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.797959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.798936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799271 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799681 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.799991 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.800215 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.800344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.800529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.800687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.800842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801814 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.801908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124590) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 22:34:40.802145 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.802457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.802804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.803144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.803496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.803809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.804155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.804489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.804829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.805142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.805452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 31 22:34:40.805698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124589) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 31 22:34:40.862509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Registered counter for database nova_api May 31 22:34:40.865568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Registered counter for database nova_api May 31 22:34:40.882225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.884855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.888972 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:40.891234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:40.947020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.context [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa724526-4fde-4fd6-8234-378dff7993fa(cell1) {{(pid=124590) load_cells /opt/stack/nova/nova/context.py:464}} May 31 22:34:40.948054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.context [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),aa724526-4fde-4fd6-8234-378dff7993fa(cell1) {{(pid=124589) load_cells /opt/stack/nova/nova/context.py:464}} May 31 22:34:40.951157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:34:40.952116 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:34:40.952733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:34:40.953535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:34:40.953666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:34:40.954467 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:34:40.955527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:34:40.956443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:34:40.957483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Registered counter for database nova_cell0 May 31 22:34:40.958379 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Registered counter for database nova_cell0 May 31 22:34:40.962222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Registered counter for database nova_cell1 May 31 22:34:40.962875 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Registered counter for database nova_cell1 May 31 22:34:40.969546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.971552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.973386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.974367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:40.979281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:40.979887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:40.982403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:40.985210 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:41.130316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO dbcounter [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Registered counter for database nova_cell0 May 31 22:34:41.131018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO dbcounter [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Registered counter for database nova_cell0 May 31 22:34:41.138955 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_db.sqlalchemy.engines [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124590) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:41.140528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_db.sqlalchemy.engines [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124589) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 31 22:34:41.144484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writer thread running {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:41.144992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writer thread running {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 31 22:34:41.582687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:34:41.584203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:34:41.591144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:34:41.591552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:34:41.819493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:34:41.821327 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 31 22:34:41.826008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: WARNING keystonemiddleware.auth_token [None req-85817936-570e-459a-a1f0-89fc63cc6ec5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:34:41.827855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: WARNING keystonemiddleware.auth_token [None req-338ae7e9-07c8-40b2-88cc-e9515ccb6bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 31 22:34:41.831274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abd798b9c0 pid: 124590 (default app) May 31 22:34:41.832998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abd798b9c0 pid: 124589 (default app) May 31 22:35:21.565344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:21.566163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:21.566903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:21.567671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:22.516887 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7ebb3858-6113-4752-8af2-2c9eb49d344b tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Action: 'create', calling method: .version_select at 0x7ff4603c0310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1456315634"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:24.463247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7ebb3858-6113-4752-8af2-2c9eb49d344b tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.908824 May 31 22:35:24.464538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 1/1] 10.222.0.39 () {60 vars in 1154 bytes} [Tue May 31 22:35:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2912 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 22:35:24.783364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a1c82fc-70ac-4678-8047-d47279816efa tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4603f3dc0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:24.819623 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:24.821379 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:24.822310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:24.823344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:25.896249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a1c82fc-70ac-4678-8047-d47279816efa tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 200 len: 346 microversion: 2.1 time: 1.421989 May 31 22:35:25.905771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 1/2] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:35:24 2022] GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 346 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:25.910626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d4f652dd-8f4d-4b1e-87f4-2c308156e772 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Action: 'create', calling method: .version_select at 0x7ff460285280>, body: {"snapshot": {"volume_id": "d303f681-2013-46c6-851c-9eedd6ea492f", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-199162046"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:26.647189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d4f652dd-8f4d-4b1e-87f4-2c308156e772 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.741884 May 31 22:35:26.648038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 2/3] 10.222.0.39 () {60 vars in 1161 bytes} [Tue May 31 22:35:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:26.658310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9f40fba2-f162-4510-aa7b-b97114353eb0 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff46026c310>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:26.701224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9f40fba2-f162-4510-aa7b-b97114353eb0 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 286 microversion: 2.1 time: 0.046951 May 31 22:35:26.710858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:26 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:26.717095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b444432e-2a89-4a93-9bde-8450af920385 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff460285940>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:26.834918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b444432e-2a89-4a93-9bde-8450af920385 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.127196 May 31 22:35:26.836255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 3/5] 10.222.0.39 () {58 vars in 1139 bytes} [Tue May 31 22:35:26 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:26.847113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e4cfec2a-6906-4e48-ba2d-88946b5b24d4 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff46026c550>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:26.921593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e4cfec2a-6906-4e48-ba2d-88946b5b24d4 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 286 microversion: 2.1 time: 0.079093 May 31 22:35:26.923262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 3/6] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:26 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 286 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:27.357557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-884289453", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "networks": [{"uuid": "53e5aebc-7503-49bf-9329-1576c981ea7e"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:27.484674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] validate_networks() for [('53e5aebc-7503-49bf-9329-1576c981ea7e', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:27.936705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-77788608-3d9f-40f9-a969-bfbb1211bcc0 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff46026cb80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:28.006806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-77788608-3d9f-40f9-a969-bfbb1211bcc0 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 286 microversion: 2.1 time: 0.073875 May 31 22:35:28.007517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:27 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 286 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:35:29.019372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-180daf66-edee-497b-9e41-09e160b85543 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff460293280>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:29.135510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-180daf66-edee-497b-9e41-09e160b85543 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 286 microversion: 2.1 time: 0.120572 May 31 22:35:29.136656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:29 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:35:29.722946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:35:29.724060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:35:29.724778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:35:29.725972 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:35:29.727445 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:35:29.756177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:29.759390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:29.760672 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:29.763970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:29.831286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Getting quotas for project 2bdb186b8b2941d390fae360da76e6db. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:29.852352 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Getting quotas for user c9cd95bbe8024f028ae43eb6479b2a06 and project 2bdb186b8b2941d390fae360da76e6db. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:29.876270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:35:29.880307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:35:30.134393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63abf3b1-5cc9-4664-9561-0bee6336b821 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.996663 May 31 22:35:30.135780 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 4/9] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:35:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:35:30.148996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-67cff5ff-c7a8-451c-ab67-b65d24e34e33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:30.148996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-67cff5ff-c7a8-451c-ab67-b65d24e34e33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:30.149879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4aaf5e81-8d2c-4b26-a9bc-94bae7fa7a73 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff45f921f70>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:30.236881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4aaf5e81-8d2c-4b26-a9bc-94bae7fa7a73 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 287 microversion: 2.1 time: 0.090040 May 31 22:35:30.236881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 5/10] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:30 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:35:30.248624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-270bc82b-5b1a-495e-9764-be7dadffcf0e tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff45f936700>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:30.303667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-67cff5ff-c7a8-451c-ab67-b65d24e34e33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:30.326552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-67cff5ff-c7a8-451c-ab67-b65d24e34e33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1214 microversion: 2.1 time: 0.184619 May 31 22:35:30.329350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 6/11] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:30 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1214 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:30.492686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-270bc82b-5b1a-495e-9764-be7dadffcf0e tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "DELETE /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 202 len: 0 microversion: 2.1 time: 0.248764 May 31 22:35:30.494219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1253 bytes} [Tue May 31 22:35:30 2022] DELETE /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:35:30.502496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-84352265-dcdd-4a0f-9b5a-520f5a221aaf tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff46026c940>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:30.552795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-84352265-dcdd-4a0f-9b5a-520f5a221aaf tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 200 len: 286 microversion: 2.1 time: 0.054204 May 31 22:35:30.553424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:30 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:31.345067 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95e597b6-2654-4d85-b94c-1e7418403cd5 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:31.347762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95e597b6-2654-4d85-b94c-1e7418403cd5 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:31.565437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce4e5728-abb1-40b0-8c29-56dd2e5e23dc tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601db1f0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:31.616863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-ce4e5728-abb1-40b0-8c29-56dd2e5e23dc tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] HTTP exception thrown: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce4e5728-abb1-40b0-8c29-56dd2e5e23dc tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Request method failure captured: May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 HTTP/1.1 May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpgp9P_HkX9ilfhh6nix8X_hjkRz3R6Jn7PkI6IDyUzj61sa23M6IDyCp2OTHxUilPohoX2jVso_EveYmzLLwDiBv4DHNCHWUUUh0wLTV5zUHHa2FJu68pKXxUbmmOZ7ZiR4B30xkAaBxDH1FssJDXgZ6VNiujSWTWElDCqDCLXkm9U May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:31.621703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_faa6d1f1a42e43d6be71acbe25455afc"}]}] May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: a4835977127842e5bfc9373a90ffc18f May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'f714b31b-c700-4db5-ac34-fa30538610d5'} May 31 22:35:31.627286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. (HTTP 404) (Request-ID: req-5fbc8fcc-cefa-404e-8ddc-dd3cb1406b73) May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.628093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:31.629016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 31 22:35:31.629982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:31.631898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce4e5728-abb1-40b0-8c29-56dd2e5e23dc tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Returning 404 to user: Snapshot f714b31b-c700-4db5-ac34-fa30538610d5 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:31.638114 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce4e5728-abb1-40b0-8c29-56dd2e5e23dc tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5" status: 404 len: 111 microversion: 2.1 time: 0.077624 May 31 22:35:31.639400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 8/14] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:35:31 2022] GET /compute/v2.1/os-snapshots/f714b31b-c700-4db5-ac34-fa30538610d5 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:35:31.657369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1293267f-f213-4734-9e82-2d105d3d8a88 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601b9280>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:31.964357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1293267f-f213-4734-9e82-2d105d3d8a88 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 202 len: 0 microversion: 2.1 time: 0.320069 May 31 22:35:31.965006 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 9/15] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:35:31 2022] DELETE /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:35:31.975822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7264e0a1-ba35-4405-9d1b-609455970ddb tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601b99d0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:31.983265 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95e597b6-2654-4d85-b94c-1e7418403cd5 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:32.022652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95e597b6-2654-4d85-b94c-1e7418403cd5 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1214 microversion: 2.1 time: 0.680871 May 31 22:35:32.024545 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 7/16] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:31 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1214 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:32.094837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7264e0a1-ba35-4405-9d1b-609455970ddb tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 200 len: 345 microversion: 2.1 time: 0.125215 May 31 22:35:32.095726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 10/17] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:35:31 2022] GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 345 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:33.054008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6a467857-ddc3-46e6-abc3-255be5e3f827 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:33.056412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a467857-ddc3-46e6-abc3-255be5e3f827 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:33.111057 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b03809d4-a9b9-490b-97d6-1db244b54d27 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601b9d30>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:33.174679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-b03809d4-a9b9-490b-97d6-1db244b54d27 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] HTTP exception thrown: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b03809d4-a9b9-490b-97d6-1db244b54d27 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Request method failure captured: May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f HTTP/1.1 May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpgp9P_HkX9ilfhh6nix8X_hjkRz3R6Jn7PkI6IDyUzj61sa23M6IDyCp2OTHxUilPohoX2jVso_EveYmzLLwDiBv4DHNCHWUUUh0wLTV5zUHHa2FJu68pKXxUbmmOZ7ZiR4B30xkAaBxDH1FssJDXgZ6VNiujSWTWElDCqDCLXkm9U May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:33.177233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_faa6d1f1a42e43d6be71acbe25455afc"}]}] May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: a4835977127842e5bfc9373a90ffc18f May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'd303f681-2013-46c6-851c-9eedd6ea492f'} May 31 22:35:33.178468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. (HTTP 404) (Request-ID: req-1dbd5ea9-15f5-46c4-a7e7-91f3d4df316f) May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.179333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:33.180341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 22:35:33.181260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b03809d4-a9b9-490b-97d6-1db244b54d27 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Returning 404 to user: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b03809d4-a9b9-490b-97d6-1db244b54d27 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 404 len: 109 microversion: 2.1 time: 0.072001 May 31 22:35:33.182459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 11/18] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:35:33 2022] GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:35:33.189171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e948f36b-d752-44b7-8a28-54f9f73bbfb6 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601d8160>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:33.259084 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-e948f36b-d752-44b7-8a28-54f9f73bbfb6 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] HTTP exception thrown: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e948f36b-d752-44b7-8a28-54f9f73bbfb6 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Request method failure captured: May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f HTTP/1.1 May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpgp9P_HkX9ilfhh6nix8X_hjkRz3R6Jn7PkI6IDyUzj61sa23M6IDyCp2OTHxUilPohoX2jVso_EveYmzLLwDiBv4DHNCHWUUUh0wLTV5zUHHa2FJu68pKXxUbmmOZ7ZiR4B30xkAaBxDH1FssJDXgZ6VNiujSWTWElDCqDCLXkm9U May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:33.261121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_faa6d1f1a42e43d6be71acbe25455afc"}]}] May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: a4835977127842e5bfc9373a90ffc18f May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'd303f681-2013-46c6-851c-9eedd6ea492f'} May 31 22:35:33.262208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. (HTTP 404) (Request-ID: req-000a4dd8-6de2-42ab-b64b-7db3d0f39b1f) May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.262887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:33.263779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 22:35:33.267274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e948f36b-d752-44b7-8a28-54f9f73bbfb6 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Returning 404 to user: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e948f36b-d752-44b7-8a28-54f9f73bbfb6 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 404 len: 109 microversion: 2.1 time: 0.077387 May 31 22:35:33.268194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 12/19] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:35:33 2022] DELETE /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:35:33.271474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6159cc51-8ae1-4604-b86a-b56ece5ea5a8 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Calling method '.version_select at 0x7ff4601b9940>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:33.347162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-6159cc51-8ae1-4604-b86a-b56ece5ea5a8 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] HTTP exception thrown: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6159cc51-8ae1-4604-b86a-b56ece5ea5a8 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Request method failure captured: May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f HTTP/1.1 May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpgp9P_HkX9ilfhh6nix8X_hjkRz3R6Jn7PkI6IDyUzj61sa23M6IDyCp2OTHxUilPohoX2jVso_EveYmzLLwDiBv4DHNCHWUUUh0wLTV5zUHHa2FJu68pKXxUbmmOZ7ZiR4B30xkAaBxDH1FssJDXgZ6VNiujSWTWElDCqDCLXkm9U May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:33.349421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/faa6d1f1a42e43d6be71acbe25455afc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_faa6d1f1a42e43d6be71acbe25455afc"}]}] May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: faa6d1f1a42e43d6be71acbe25455afc May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-403362325 May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: a4835977127842e5bfc9373a90ffc18f May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotsTestJSON-403362325-project May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'd303f681-2013-46c6-851c-9eedd6ea492f'} May 31 22:35:33.350472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. (HTTP 404) (Request-ID: req-04fdf65b-182b-46db-9b9f-fb6132879634) May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.351122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:33.352570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 22:35:33.353512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. May 31 22:35:33.354376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:33.356887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6159cc51-8ae1-4604-b86a-b56ece5ea5a8 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] Returning 404 to user: Volume d303f681-2013-46c6-851c-9eedd6ea492f could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:33.359166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6159cc51-8ae1-4604-b86a-b56ece5ea5a8 tempest-VolumesSnapshotsTestJSON-403362325 tempest-VolumesSnapshotsTestJSON-403362325-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f" status: 404 len: 109 microversion: 2.1 time: 0.091449 May 31 22:35:33.360159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 13/20] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:35:33 2022] GET /compute/v2.1/os-volumes/d303f681-2013-46c6-851c-9eedd6ea492f => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:35:33.397793 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6a467857-ddc3-46e6-abc3-255be5e3f827 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:33.415147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6a467857-ddc3-46e6-abc3-255be5e3f827 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1214 microversion: 2.1 time: 0.368533 May 31 22:35:33.415147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 8/21] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:33 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1214 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:33.912731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a9c154e0-afe6-4eb2-8b03-4b2e5ff75bf5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: .version_select at 0x7ff4601b9f70>, body: {"keypair": {"name": "tempest-keypair-1071083904", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG+0jIzLbVQ8U930oKOsHGz1JIrhcNvJvY6bfVSdIWEzdtX8rPUGBwIMAoLzpufrCiJETWowOc/F7CODZiWjbmWXmuHLKyXLsW/BilCODzMcxOysb+Dc53yFljY1jy/ELQ=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:34.036475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-a9c154e0-afe6-4eb2-8b03-4b2e5ff75bf5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:34.049280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-a9c154e0-afe6-4eb2-8b03-4b2e5ff75bf5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:34.270499 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a9c154e0-afe6-4eb2-8b03-4b2e5ff75bf5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.844569 May 31 22:35:34.271215 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 14/22] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:35:33 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:34.430292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:34.430973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:34.453183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:34.465364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:34.466411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:34.467091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:35.300463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:35.328016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-34f3c20a-df29-45ad-9d2c-44787d48f151 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1266 microversion: 2.1 time: 0.900874 May 31 22:35:35.329288 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 9/23] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:34 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1266 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:36.349480 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:36.350491 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:36.361644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:36.362025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:36.362909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:36.363350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:37.136014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:37.157646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-52651544-139d-4fdc-9a06-82786c71166c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1272 microversion: 2.1 time: 0.812109 May 31 22:35:37.165174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 15/24] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:36 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1272 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:38.061185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4aa70e4b-f111-470b-a743-305b3c0b0595 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Action: 'create', calling method: .version_select at 0x7ff45f05ff70>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1355080133", "metadata": {"Type": "work"}}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4aa70e4b-f111-470b-a743-305b3c0b0595 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 122 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:35:38.064713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1355080133", "metadata": {"Type": "work"}}} May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: May 31 22:35:38.065724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1355080133', 'metadata': {'Type': 'work'}}}} May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise error May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi '#$%' May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.066346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 22:35:38.067483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 22:35:38.068358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 31 22:35:38.068358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.068358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4aa70e4b-f111-470b-a743-305b3c0b0595 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.068358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4aa70e4b-f111-470b-a743-305b3c0b0595 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.388402 May 31 22:35:38.084384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1454b072-511d-4f2f-96d2-2fd91370d6a2 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Action: 'create', calling method: .version_select at 0x7ff45f8cff70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1970220026", "metadata": {"Type": "work"}}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1454b072-511d-4f2f-96d2-2fd91370d6a2 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 120 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:38.092089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1970220026", "metadata": {"Type": "work"}}} May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:38.093451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1970220026', 'metadata': {'Type': 'work'}}}} May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise error May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi '0' May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.094089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 22:35:38.095238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 22:35:38.096175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 31 22:35:38.096175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.096175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1454b072-511d-4f2f-96d2-2fd91370d6a2 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.096343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 10/25] 10.222.0.39 () {60 vars in 1155 bytes} [Tue May 31 22:35:37 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 414 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 22:35:38.096417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1454b072-511d-4f2f-96d2-2fd91370d6a2 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.020417 May 31 22:35:38.102740 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 16/26] 10.222.0.39 () {60 vars in 1155 bytes} [Tue May 31 22:35:38 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 22:35:38.108917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b5d9af48-474e-4380-8a07-f43abc066a23 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Action: 'create', calling method: .version_select at 0x7ff45f08f4c0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1885936253", "metadata": {"Type": "work"}}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b5d9af48-474e-4380-8a07-f43abc066a23 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 119 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:35:38.114080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1885936253", "metadata": {"Type": "work"}}} May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: May 31 22:35:38.115341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1885936253', 'metadata': {'Type': 'work'}}}} May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise error May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi On instance['volume']: May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi '' May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.116111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 31 22:35:38.118713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 31 22:35:38.123578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 31 22:35:38.123578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:35:38.123578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b5d9af48-474e-4380-8a07-f43abc066a23 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.123578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b5d9af48-474e-4380-8a07-f43abc066a23 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018424 May 31 22:35:38.129886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 11/27] 10.222.0.39 () {60 vars in 1155 bytes} [Tue May 31 22:35:38 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 22:35:38.136510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56c56216-6f29-4a92-a65b-3ac7cb15d76b tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Calling method '.version_select at 0x7ff45f882b80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:38.197915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:38.197915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:38.204624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:38.208304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:38.210158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:38.214957 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:38.236155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-56c56216-6f29-4a92-a65b-3ac7cb15d76b tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] HTTP exception thrown: Volume tempest-invalid-2021615075 could not be found. May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56c56216-6f29-4a92-a65b-3ac7cb15d76b tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2021615075 HTTP/1.1 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:38.238530 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume tempest-invalid-2021615075 could not be found. May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'tempest-invalid-2021615075'} May 31 22:35:38.239994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2021615075 could not be found. (HTTP 404) (Request-ID: req-9672f2f7-6303-4cb4-b775-fef7795805df) May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.246171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:38.247807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2021615075 could not be found. May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:38.248863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2021615075 could not be found. May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2021615075 could not be found. May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-56c56216-6f29-4a92-a65b-3ac7cb15d76b tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 404 to user: Volume tempest-invalid-2021615075 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-56c56216-6f29-4a92-a65b-3ac7cb15d76b tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2021615075" status: 404 len: 99 microversion: 2.1 time: 0.108970 May 31 22:35:38.250209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 17/28] 10.222.0.39 () {58 vars in 1217 bytes} [Tue May 31 22:35:38 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2021615075 => generated 99 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 31 22:35:38.251364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2287ae28-92cf-440d-a355-c917f90efff1 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004135 May 31 22:35:38.260063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 18/29] 10.222.0.39 () {58 vars in 1139 bytes} [Tue May 31 22:35:38 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 13 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 31 22:35:38.275173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8dcaa9bb-22d0-49df-9a41-ce0341ef6f3d tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004198 May 31 22:35:38.275953 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 19/30] 10.222.0.39 () {58 vars in 1136 bytes} [Tue May 31 22:35:38 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 31 22:35:38.287281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-135a92c1-691f-4aa1-86e4-7523271d0efc tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Calling method '.version_select at 0x7ff45f8cff70>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:38.358449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-135a92c1-691f-4aa1-86e4-7523271d0efc tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] HTTP exception thrown: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-135a92c1-691f-4aa1-86e4-7523271d0efc tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/os-volumes/23d42293-2fea-4054-b9ce-b7d90eedcc39 HTTP/1.1 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:38.360684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '23d42293-2fea-4054-b9ce-b7d90eedcc39'} May 31 22:35:38.361938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. (HTTP 404) (Request-ID: req-8b6c7d67-099d-4fbb-8eb5-4490b9390af6) May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.362682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 31 22:35:38.364367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 31 22:35:38.365511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. May 31 22:35:38.366667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.370289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-135a92c1-691f-4aa1-86e4-7523271d0efc tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 404 to user: Volume 23d42293-2fea-4054-b9ce-b7d90eedcc39 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.370516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-135a92c1-691f-4aa1-86e4-7523271d0efc tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/23d42293-2fea-4054-b9ce-b7d90eedcc39" status: 404 len: 109 microversion: 2.1 time: 0.087413 May 31 22:35:38.371437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 20/31] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:35:38 2022] DELETE /compute/v2.1/os-volumes/23d42293-2fea-4054-b9ce-b7d90eedcc39 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:35:38.382049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6c6cfd11-3d15-4bd4-9f95-c701dd559a81 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Calling method '.version_select at 0x7ff45f8cfc10>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:38.424922 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-6c6cfd11-3d15-4bd4-9f95-c701dd559a81 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] HTTP exception thrown: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6c6cfd11-3d15-4bd4-9f95-c701dd559a81 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Request method failure captured: May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/b066725a-c767-4cf7-bf3e-19cdc6b70e79 HTTP/1.1 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg5Dk8WanuPlsZttNh1WxGc9wKRlYh01PFKwqp37Zk2GdlXOA9Nlyc6eCOq3TerXgwOuJuF-iuLGzrOh5q_NSn_k0nL0UP9cuZ_MbSwhgGIwkhtr5N2BjjYV9Nzk9TUCaAFE_KF7U4uYvG1fSCwl5-hJoWYJgKB81mh4KavMzN2wR8 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:35:38.427147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4a899c2034c14a0e9c27f9fe173c6f0a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4a899c2034c14a0e9c27f9fe173c6f0a"}]}] May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 4a899c2034c14a0e9c27f9fe173c6f0a May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesNegativeTest-1411232360 May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 2352bf9e57eb4b2bb7a1bb8cd7d87dc0 May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesNegativeTest-1411232360-project May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'b066725a-c767-4cf7-bf3e-19cdc6b70e79'} May 31 22:35:38.428322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. (HTTP 404) (Request-ID: req-5c220585-6e34-420e-9c5c-01cf6dbda40e) May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.429048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:35:38.430111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 22:35:38.431121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. May 31 22:35:38.432402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:35:38.437921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6c6cfd11-3d15-4bd4-9f95-c701dd559a81 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] Returning 404 to user: Volume b066725a-c767-4cf7-bf3e-19cdc6b70e79 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:35:38.440968 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6c6cfd11-3d15-4bd4-9f95-c701dd559a81 tempest-VolumesNegativeTest-1411232360 tempest-VolumesNegativeTest-1411232360-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/b066725a-c767-4cf7-bf3e-19cdc6b70e79" status: 404 len: 109 microversion: 2.1 time: 0.064172 May 31 22:35:38.445051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 21/32] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:35:38 2022] GET /compute/v2.1/os-volumes/b066725a-c767-4cf7-bf3e-19cdc6b70e79 => generated 109 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:35:39.197696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:39.211155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c50b1399-4b0b-4e76-b61f-1a4e720661a7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 1.028888 May 31 22:35:39.224052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 12/33] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:38 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:40.230328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:40.231621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:40.242513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:40.261871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:40.266163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:40.275288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:41.103501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:41.132279 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-036898f2-674a-4f2c-8f9a-aa731f79a2a0 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.906326 May 31 22:35:41.146799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 22/34] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:40 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:42.153181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:42.154524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:42.168491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:42.199220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:42.200334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:42.204594 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:42.206329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:43.402391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=10 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:43.712251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:43.785591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1fee1493-9280-438e-8b06-7578c3b076f4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 1.615782 May 31 22:35:43.785591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 13/35] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:42 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 1626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:44.795932 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:44.796644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:44.839676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:44.839676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:44.841890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:44.841890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:44.841890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:45.274315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-875046065", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a18a0f-17f5-48fc-adf9-abe14bc8b4bd"}], "security_groups": [{"name": "tempest-securitygroup--2126396818"}], "key_name": "tempest-keypair-1071083904", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:45.765375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] validate_networks() for [('10a18a0f-17f5-48fc-adf9-abe14bc8b4bd', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:46.292459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:46.316287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b740110d-1de0-47b4-9a8e-d0af7e015523 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 1.534301 May 31 22:35:46.320766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 23/36] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:44 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 1543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:46.687428 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-50ea7de1-2e2a-4bad-ad1a-5fe6811819d4 req-1fc431fa-7aed-4207-ae38-46cf0b3090c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25293baf-85ff-4dbd-8992-e106893eb7b5", "tag": "b9325744-3e90-493c-b35c-0ea3530a2ff6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:46.708931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-50ea7de1-2e2a-4bad-ad1a-5fe6811819d4 req-1fc431fa-7aed-4207-ae38-46cf0b3090c4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:46.712285 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-50ea7de1-2e2a-4bad-ad1a-5fe6811819d4 req-1fc431fa-7aed-4207-ae38-46cf0b3090c4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:46.743884 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-50ea7de1-2e2a-4bad-ad1a-5fe6811819d4 req-1fc431fa-7aed-4207-ae38-46cf0b3090c4 service nova] Creating event network-changed:b9325744-3e90-493c-b35c-0ea3530a2ff6 for instance 25293baf-85ff-4dbd-8992-e106893eb7b5 on hv-cinder-84414 May 31 22:35:46.744834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-50ea7de1-2e2a-4bad-ad1a-5fe6811819d4 req-1fc431fa-7aed-4207-ae38-46cf0b3090c4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 22:35:46.757522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:46.759553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:46.761346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:46.762570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:46.798908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.compute.rpcapi [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 22:35:46.801551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] Releasing lock "compute-rpcapi-router" {{(pid=124589) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 22:35:46.861253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-57ca3f60-1986-4cb4-9263-98d844d9e9e8 None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.538867 May 31 22:35:46.863943 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 24/37] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:47.343613 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:47.344456 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:47.363306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:47.363763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:47.364571 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:47.365019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:48.194669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:48.203027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-68c6c6b5-be41-46d6-8890-68fbf4bf9531 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.870225 May 31 22:35:48.208769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 25/38] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:47 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:35:48.635543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:35:48.636010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:35:48.636406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:35:48.636883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:35:48.637309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:35:48.662676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:48.663818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:48.664688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:48.665180 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:48.737349 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:48.757304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:48.798467 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:35:48.800649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:35:49.060440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c040ca20-5129-487f-af3a-a7ad4afaa716 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.792393 May 31 22:35:49.062232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 14/39] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:35:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 3795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:35:49.093118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e429bea6-e2e7-4dfe-9977-187a0e3cc663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:49.093752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e429bea6-e2e7-4dfe-9977-187a0e3cc663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:49.284828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e429bea6-e2e7-4dfe-9977-187a0e3cc663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:49.296248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e429bea6-e2e7-4dfe-9977-187a0e3cc663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1241 microversion: 2.1 time: 0.227331 May 31 22:35:49.296831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 15/40] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:49 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1241 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:49.329083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:49.329816 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:49.341896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:49.362401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:49.363614 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:49.365791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:49.674960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af1c3c7c-d003-4e24-9631-201902c5e303 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: .version_select at 0x7ff45f7e2820>, body: {"keypair": {"name": "tempest-keypair-237008043", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMlhhjXJA1UWaGQ1+dAXzS8hhzRmtEw9fR9mrLfyoLDImdiS2tEq+t0TzlH51WGrUoxEvi9CDEv0YvnNT4npKP2Dp0Iz1bzRNz5y+IMTNlgEqoKvyJmISPJQr5hErZZaw=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:49.738846 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-af1c3c7c-d003-4e24-9631-201902c5e303 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:49.765019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-af1c3c7c-d003-4e24-9631-201902c5e303 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for user b255effa528e4100b288994bedd3c75b and project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:49.878837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:49.890688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2ff3a3ba-fd44-4f85-980e-0e0dd9d34659 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.583356 May 31 22:35:49.892655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 16/41] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:49 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:49.918342 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af1c3c7c-d003-4e24-9631-201902c5e303 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.260555 May 31 22:35:49.933300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 26/42] 10.222.0.39 () {62 vars in 1199 bytes} [Tue May 31 22:35:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1264 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 22:35:50.090337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-479785425", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:50.205129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] validate_networks() for [('aa326e9b-c8ca-45b9-8e5f-fbba99d36365', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:50.333992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f3a46814-a0df-4569-9b69-d1576611e498 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: .version_select at 0x7ff45f8585e0>, body: {"keypair": {"name": "tempest-keypair-418908735", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTymTDbXnsZyoPHR+ASWaLeqc+g6peXryPMCGZA9a0MSUThTZ5Tkwd+Iq7uzBkx4HY8xOkVZGtYBFSy2DnSbsghOSN2ikWa/PBNP6FTsWK4QKTyERm/tndaAB+qEyKjXg=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:50.371032 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-f3a46814-a0df-4569-9b69-d1576611e498 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for project ae8802f7cc3d492db27311ca9c98c124. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:50.391566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-f3a46814-a0df-4569-9b69-d1576611e498 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for user 0a1af4f589cb41af9920e04c2130d49f and project ae8802f7cc3d492db27311ca9c98c124. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:50.521600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f3a46814-a0df-4569-9b69-d1576611e498 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.328726 May 31 22:35:50.522214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 27/43] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:35:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:35:50.535116 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d623249e-13cc-458b-803e-f0022deb7c3a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:50.535902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d623249e-13cc-458b-803e-f0022deb7c3a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:50.742849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d623249e-13cc-458b-803e-f0022deb7c3a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:50.755462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d623249e-13cc-458b-803e-f0022deb7c3a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1241 microversion: 2.1 time: 0.222284 May 31 22:35:50.768935 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 28/44] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:50 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1241 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:50.910626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:50.911389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:50.930279 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:50.930741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:50.931575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:50.932289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:51.912159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:51.932993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c6960b7-016a-4f0e-aa76-9c794bd77b33 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 1.027065 May 31 22:35:51.934728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 29/45] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:50 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:35:51.947579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:51.947579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:51.956203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:51.957233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:51.958403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:51.959203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:52.091738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:35:52.092259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:35:52.092922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:35:52.093513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:35:52.094344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:35:52.099783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:52.149270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:52.153833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:52.159526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:52.166932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:52.183596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=29 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:52.185122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:52.198214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5fa8e711-5454-49d7-b62d-e6b0c160dd55 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1245 microversion: 2.1 time: 0.261758 May 31 22:35:52.201006 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 30/46] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:51 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1245 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:52.239030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:52.256875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for user 0a5a154e334e49db92d41cefaf75ef27 and project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:52.349753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:35:52.356399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:35:52.685451 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c052a16a-e26f-4340-9dd1-11d40aef7925 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.790658 May 31 22:35:52.687934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 17/47] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:35:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 2793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:35:52.698855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f98ba10d-c5ad-47c9-8628-72ab75286b40 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:52.699737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f98ba10d-c5ad-47c9-8628-72ab75286b40 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:52.871471 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f98ba10d-c5ad-47c9-8628-72ab75286b40 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:52.891230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f98ba10d-c5ad-47c9-8628-72ab75286b40 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1221 microversion: 2.1 time: 0.185653 May 31 22:35:52.891230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 31/48] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:52 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1221 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:35:52.951655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:52.952255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:52.968488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:52.969061 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:52.969905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:52.970357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:53.190033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-881553459", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:53.319146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] validate_networks() for [('aa326e9b-c8ca-45b9-8e5f-fbba99d36365', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:53.357064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:53.368986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80fbc3ae-79b1-4954-8a6b-3380763f2004 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.417272 May 31 22:35:53.370528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 18/49] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:52 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:53.387197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:53.387842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:53.406416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:53.406890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:53.407852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:53.408439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:53.564325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:53.577038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c7cb3c1b-4e22-47cd-8cb8-10b1d9c4e61a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1293 microversion: 2.1 time: 0.203721 May 31 22:35:53.577904 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 19/50] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:53 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1293 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:54.388302 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:54.401388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:54.435369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:54.436028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:54.456979 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:54.458113 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:54.949346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:54.958390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6dff7fa1-2ed4-4bcb-a149-827308d0a0ef tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.576554 May 31 22:35:54.960032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 20/51] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:54 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:54.974923 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:54.975430 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:54.984494 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:54.985033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:54.985894 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:54.986345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:55.068001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:55.087369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e7fa7679-46eb-45a4-9142-bbbbf180a48d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1301 microversion: 2.1 time: 0.123859 May 31 22:35:55.094363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 21/52] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:54 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1301 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:55.141857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:35:55.143519 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:35:55.144520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:35:55.145140 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:35:55.145715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:35:55.148497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:35:55.165655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:55.166440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:55.167590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:55.168217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:55.243322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:55.262647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for user 0a5a154e334e49db92d41cefaf75ef27 and project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:55.305609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:35:55.329923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:35:55.528665 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d35e78f2-72f1-49b9-a2fb-dd7b352dcff7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.343051 May 31 22:35:55.531108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 32/53] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:35:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 2346 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 31 22:35:55.539841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d27a16a1-d209-4e97-bdb9-38f82bb271e1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:55.540367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d27a16a1-d209-4e97-bdb9-38f82bb271e1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:55.977228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:55.982302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:55.993613 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:55.997751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:56.000223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:56.002648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:56.028579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d27a16a1-d209-4e97-bdb9-38f82bb271e1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:56.037044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d27a16a1-d209-4e97-bdb9-38f82bb271e1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1221 microversion: 2.1 time: 0.501359 May 31 22:35:56.039342 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 22/54] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:55 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1221 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:56.111096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:56.112049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:56.121759 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:56.126022 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:56.127152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:56.128976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:56.281034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:56.295765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-26ae3060-3282-4f0c-98b7-d0be8bc2b616 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.322647 May 31 22:35:56.296698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 33/55] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:55 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:35:56.332894 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:56.354431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0119184d-4427-4d4a-9a1b-cf6bd7163cc9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1299 microversion: 2.1 time: 0.246415 May 31 22:35:56.356270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 23/56] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:56 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1299 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:57.055270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:57.056100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:57.072816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.074039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.077596 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.078376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.314600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:57.315462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:57.335807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.337961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.339700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.342732 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.412456 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:57.461243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-465054ec-601a-461c-91ff-ec0653bc0485 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1225 microversion: 2.1 time: 0.409027 May 31 22:35:57.462579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 34/57] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:57 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1225 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:57.502233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:57.503265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:57.527744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.528201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.528984 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:57.529419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:57.698270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:57.708346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:57.716073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-25af0815-4c33-4732-bca0-ffadcfc1b4a9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.404578 May 31 22:35:57.717652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 24/58] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:57 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:57.724547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1632961e-1234-47af-ab2c-59b84c0a7df9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1299 microversion: 2.1 time: 0.259168 May 31 22:35:57.725419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 35/59] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:57 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1299 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:58.476919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1516243919", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd0e2bf1-eb31-446c-bfe2-db0358452d4e"}], "security_groups": [{"name": "tempest-securitygroup--1465207809"}], "key_name": "tempest-keypair-237008043", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:58.478054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:58.479412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:58.489388 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:58.492852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:58.494429 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:58.496502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:58.626765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:35:58.635991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6c77fef9-ec6d-49f9-8a10-be6c54aa4508 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1273 microversion: 2.1 time: 0.162244 May 31 22:35:58.643107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 36/60] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:58 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1273 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:35:58.681407 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-788386792", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be8b41ab-f3a4-421d-990d-6bcaad944e0b"}], "security_groups": [{"name": "tempest-securitygroup--970275759"}], "key_name": "tempest-keypair-418908735", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:35:58.784561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] validate_networks() for [('dd0e2bf1-eb31-446c-bfe2-db0358452d4e', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:59.098005 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] validate_networks() for [('be8b41ab-f3a4-421d-990d-6bcaad944e0b', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:35:59.665608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:35:59.667349 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:35:59.667982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:35:59.668646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:35:59.669208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:35:59.685666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:59.687883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:59.689931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:59.690549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:59.721692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:35:59.727491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for user b255effa528e4100b288994bedd3c75b and project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:35:59.739506 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:35:59.742054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:35:59.910517 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bd0c89d4-c05d-4e12-a7e1-ccbb5f4dc9d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.447715 May 31 22:35:59.911853 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 25/61] 10.222.0.39 () {62 vars in 1187 bytes} [Tue May 31 22:35:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1450 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 22:35:59.918591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:35:59.919994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:35:59.929729 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:59.932653 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:35:59.932653 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:35:59.933046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.236471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.248983 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-647945d8-208e-4fc0-8646-e7eba302f56c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.334934 May 31 22:36:00.253673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 26/62] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:35:59 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:00.268495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:00.269213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:00.278958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.279787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.280847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.281381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.386326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:36:00.386945 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:36:00.387669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:36:00.388913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:36:00.389432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:36:00.408845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.408845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.409560 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.410156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.435937 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for project ae8802f7cc3d492db27311ca9c98c124. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:36:00.442118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for user 0a1af4f589cb41af9920e04c2130d49f and project ae8802f7cc3d492db27311ca9c98c124. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:36:00.457385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.469727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-994b635c-17c7-40a4-bd40-097073fbce56 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.205673 May 31 22:36:00.472420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 27/63] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:00 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:00.476219 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:36:00.481428 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:36:00.484772 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:00.489085 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:00.506987 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.508215 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.509010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:00.511191 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:00.625190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.638760 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d6cac88d-0886-41cc-a871-31c21b8ded8c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1279 microversion: 2.1 time: 0.163267 May 31 22:36:00.641687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 28/64] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:00 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1279 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:00.661444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:00.662978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:00.732906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ec67076-e0dd-4248-95c0-0e2e2f329261 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.060114 May 31 22:36:00.736903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.743692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 37/65] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:35:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 2072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:36:00.749098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.749997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:00.751442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4a0cbee2-ef78-49e1-9020-ae9053bf4123 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1281 microversion: 2.20 time: 0.105439 May 31 22:36:00.759769 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 29/66] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:00 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1281 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:00.770027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1d959647-a847-4b9b-9cf4-a1605b9121b4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:00.779815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1d959647-a847-4b9b-9cf4-a1605b9121b4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:00.998683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1d959647-a847-4b9b-9cf4-a1605b9121b4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:01.010544 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1d959647-a847-4b9b-9cf4-a1605b9121b4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1236 microversion: 2.1 time: 0.257329 May 31 22:36:01.011873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 38/67] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:00 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1236 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:01.275941 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:01.279228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:01.325166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.327297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.328287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.330450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.487586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:01.493244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:01.497957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.498757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.499866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.500565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.569320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:01.598450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b9ef1e49-53a7-4035-9a33-df2165a20ac7 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.333273 May 31 22:36:01.607547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 30/68] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:01 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:01.626384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-14de7fad-ed54-427a-ae5c-84f6b11a2910 req-04e5b3b6-47c9-48f2-965a-27cb1f196092 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60508e7-6ac1-4814-99ee-6e8d1d4e2057", "tag": "c597d8de-7087-4446-90e2-a5e14a1cda66"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:01.670183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-14de7fad-ed54-427a-ae5c-84f6b11a2910 req-04e5b3b6-47c9-48f2-965a-27cb1f196092 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.674059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-14de7fad-ed54-427a-ae5c-84f6b11a2910 req-04e5b3b6-47c9-48f2-965a-27cb1f196092 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.720136 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-14de7fad-ed54-427a-ae5c-84f6b11a2910 req-04e5b3b6-47c9-48f2-965a-27cb1f196092 service nova] Creating event network-changed:c597d8de-7087-4446-90e2-a5e14a1cda66 for instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 on hv-cinder-84414 May 31 22:36:01.720796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-14de7fad-ed54-427a-ae5c-84f6b11a2910 req-04e5b3b6-47c9-48f2-965a-27cb1f196092 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 31 22:36:01.722518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.725534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.727746 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.729377 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.742401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.compute.rpcapi [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 31 22:36:01.743978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] Releasing lock "compute-rpcapi-router" {{(pid=124590) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 31 22:36:01.768833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-67dc7880-a7fb-4002-8ce2-55cc470fcb4a None None] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.159555 May 31 22:36:01.770060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 31/69] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:01.776223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:01.790711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:01.799011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.799718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:01.800980 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:01.801582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.124852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.131673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.134896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-95cde4e9-0d3c-46e4-9000-8f751f9179c5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.648782 May 31 22:36:02.144190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ec15c4df-6f9f-4a37-8219-9763e564e69b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.371562 May 31 22:36:02.145670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 39/70] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:01 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:02.150768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 32/71] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:01 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:02.152199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:02.152966 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:02.160265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.160915 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.162438 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.163307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.370896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.384642 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.387168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.388762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-535b7100-9a8f-43b6-8c20-4dcd8f271ca7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1277 microversion: 2.20 time: 0.241851 May 31 22:36:02.392316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 40/72] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:02 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1277 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:02.404938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:02.405808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:02.418076 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.418773 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.419896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.420614 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.458568 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-25f037c0-6521-4dd5-a7e8-707318c4df47 req-32d6819f-5762-4167-864f-15b5d64185c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25293baf-85ff-4dbd-8992-e106893eb7b5", "name": "network-vif-plugged", "status": "completed", "tag": "b9325744-3e90-493c-b35c-0ea3530a2ff6"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:02.473120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-25f037c0-6521-4dd5-a7e8-707318c4df47 req-32d6819f-5762-4167-864f-15b5d64185c3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.473555 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-25f037c0-6521-4dd5-a7e8-707318c4df47 req-32d6819f-5762-4167-864f-15b5d64185c3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.502112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-25f037c0-6521-4dd5-a7e8-707318c4df47 req-32d6819f-5762-4167-864f-15b5d64185c3 service nova] Creating event network-vif-plugged:b9325744-3e90-493c-b35c-0ea3530a2ff6 for instance 25293baf-85ff-4dbd-8992-e106893eb7b5 on hv-cinder-84414 May 31 22:36:02.518251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-25f037c0-6521-4dd5-a7e8-707318c4df47 req-32d6819f-5762-4167-864f-15b5d64185c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.365960 May 31 22:36:02.518883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 33/73] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:02.544468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.554577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-15d096c6-4877-44a9-96ad-8dba12bac4c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1240 microversion: 2.1 time: 0.159926 May 31 22:36:02.567890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 41/74] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:02 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:02.622313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:02.623214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:02.635914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.641087 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.642303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:02.649455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:02.898807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:02.907892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5c76e68e-7fcd-4133-b4b9-f62da1e4e10a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.291496 May 31 22:36:02.908480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 34/75] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:02 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:03.158405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:03.158405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:03.161675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:03.162380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:03.169711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.171727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.175963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.176901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.177399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.182742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.186021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.187486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.524283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:03.537564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c53703df-c2b8-4d79-91a6-9b697c7e53ee tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.388994 May 31 22:36:03.538156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 42/76] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:03 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:03.545465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:03.547887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:03.555732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.556811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.562235 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.565330 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.568968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:03.582540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1c637b17-76dd-4164-9a2e-1906d5dfc2f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.424800 May 31 22:36:03.592654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 35/77] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:03 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:03.600145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:03.600968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:03.623139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.623886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.625510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.626188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.775432 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:03.787528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb04a034-e304-4ed3-9ea2-2c659309cfb2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1288 microversion: 2.1 time: 0.202144 May 31 22:36:03.788949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 36/78] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:03 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1288 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:03.927721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:03.929590 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:03.936564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.937236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:03.938218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:03.938973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.083050 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.092150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.094906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.097385 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-368d4039-1e1a-401a-9f92-bc2dcf400144 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1351 microversion: 2.20 time: 0.557296 May 31 22:36:04.103147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 43/79] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:03 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1351 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:04.122540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-98552efb-2a12-4cc9-a31c-3ce8d27970a7 req-fbbc56e6-26f8-45dd-be3f-3f779c5d821a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea73e6f2-f23d-4bab-9c42-3cd5ae60935d", "tag": "e01c4000-a281-4a40-86d1-800b7c862941"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:04.140372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-98552efb-2a12-4cc9-a31c-3ce8d27970a7 req-fbbc56e6-26f8-45dd-be3f-3f779c5d821a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.141278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-98552efb-2a12-4cc9-a31c-3ce8d27970a7 req-fbbc56e6-26f8-45dd-be3f-3f779c5d821a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.157620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.158954 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:04.162008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-98552efb-2a12-4cc9-a31c-3ce8d27970a7 req-fbbc56e6-26f8-45dd-be3f-3f779c5d821a service nova] Creating event network-changed:e01c4000-a281-4a40-86d1-800b7c862941 for instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d on hv-cinder-84414 May 31 22:36:04.167162 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3a342c32-2fad-41d1-856d-6cb04f07f1c3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.245431 May 31 22:36:04.168710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 37/80] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:03 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:04.168817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-98552efb-2a12-4cc9-a31c-3ce8d27970a7 req-fbbc56e6-26f8-45dd-be3f-3f779c5d821a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063722 May 31 22:36:04.173436 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 44/81] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:04.555747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:04.556722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:04.563799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.564261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.565031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.565503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.568514 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:04.603256 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:04.604283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:04.611357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.611900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.612791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.613610 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.754070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.762012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d09a3d70-19b7-4c0a-9fba-eb6504608a40 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.211029 May 31 22:36:04.762683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 38/82] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:04 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:04.804376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:04.805066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:04.814589 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.822302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-14a455f7-d093-4df8-a489-1deae17c799d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.225488 May 31 22:36:04.823064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 45/83] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:04 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:04.839632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.840309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.846441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:04.846441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:04.927023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:04.934919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-859adc3f-83b2-439f-9320-4f7e9c286d53 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1288 microversion: 2.1 time: 0.134395 May 31 22:36:04.935490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 39/84] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:04 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1288 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:05.122219 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:05.124160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:05.131586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.131586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.131793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.132062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.185270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:05.198853 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:05.200524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.200976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.201969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.202625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.224547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:05.234705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:05.236227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:05.238072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-be12171b-1699-440f-8163-b738200b2a0a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1351 microversion: 2.20 time: 0.121679 May 31 22:36:05.238771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 46/85] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:05 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:05.707253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:05.718543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7cea4837-c4bc-4672-8a4f-f98b6b2802c2 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.537193 May 31 22:36:05.720016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 40/86] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:05 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:05.778531 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:05.779177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:05.785527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.785977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.786755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.787219 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.839770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:05.840373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:05.846546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.847750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:05.859869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:05.860557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.162482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.173731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c69469d-34ae-4cfd-83dc-24bed1ee6cb4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.398696 May 31 22:36:06.176476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 47/87] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:05 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:06.185230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:06.187159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:06.193929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.195668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.196679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.197282 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.239665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.248792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e24a35a9-0d4e-4583-826d-461c53f8970f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.413589 May 31 22:36:06.252005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 41/88] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:05 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:06.256865 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-948b0dc2-0b12-4cf8-87e1-f1d9119d5f52 req-132a5bb4-45ce-4383-965b-cd9ffd4c8ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d93938-cb2e-41e4-88b5-70bea066592f", "tag": "95f303ca-5d62-42f3-84df-9c81bf9bc698"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:06.266410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-948b0dc2-0b12-4cf8-87e1-f1d9119d5f52 req-132a5bb4-45ce-4383-965b-cd9ffd4c8ac8 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.267196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-948b0dc2-0b12-4cf8-87e1-f1d9119d5f52 req-132a5bb4-45ce-4383-965b-cd9ffd4c8ac8 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.276074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.278924 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-948b0dc2-0b12-4cf8-87e1-f1d9119d5f52 req-132a5bb4-45ce-4383-965b-cd9ffd4c8ac8 service nova] Creating event network-changed:95f303ca-5d62-42f3-84df-9c81bf9bc698 for instance 20d93938-cb2e-41e4-88b5-70bea066592f on hv-cinder-84414 May 31 22:36:06.284503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-948b0dc2-0b12-4cf8-87e1-f1d9119d5f52 req-132a5bb4-45ce-4383-965b-cd9ffd4c8ac8 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031021 May 31 22:36:06.284649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9137297b-b274-48e2-af7d-aa310f49efb1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1294 microversion: 2.1 time: 0.106340 May 31 22:36:06.285132 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 48/89] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:06 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:06.285648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 42/90] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:06.292411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:06.293497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:06.300350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.303636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.303636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.303636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.388468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.397674 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.399379 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:06.400497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a1172e8-5a8c-44ad-aed3-ff0cdf25713e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1339 microversion: 2.20 time: 0.112263 May 31 22:36:06.401213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 49/91] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:06 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1339 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:06.738991 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:06.740187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:06.776316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.779714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:06.780768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:06.781395 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.157963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:07.168466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-144ee9a2-4910-4218-84bf-77beb06401f9 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1314 microversion: 2.1 time: 0.434645 May 31 22:36:07.171542 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 43/92] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:06 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:07.194064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:07.194706 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:07.216618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.217085 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.221918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.222465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.266567 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:07.267993 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:07.284396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.284859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.285656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.286098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.639189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:07.648506 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85b76992-e114-45f4-819e-ab70a4fd45c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.385635 May 31 22:36:07.650340 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 44/93] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:07 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:07.664624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:07.665786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:07.675676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.676386 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.677380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.677987 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.782930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:07.790687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aa3b3ab3-da99-47f1-9691-6c8e583ff376 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1294 microversion: 2.1 time: 0.138495 May 31 22:36:07.791218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 45/94] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:07 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1294 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:07.803841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:07.805085 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:07.814623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.815204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.819521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:07.819521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:07.886595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:07.895387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c7713831-8033-4cc9-b64f-d0ad1c0fa663 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.705004 May 31 22:36:07.896723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 50/95] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:07 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:08.189423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:08.190333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:08.201872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.203156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:08.204384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.206300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:08.234820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:08.255529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:08.257715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:08.259303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ab395243-26d3-4a62-ae2e-54149023e84d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.466972 May 31 22:36:08.260064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 46/96] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:07 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:08.488386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:08.496771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0830e728-fc9e-4ef9-a366-f84fb5d35dba tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1502 microversion: 2.1 time: 0.313774 May 31 22:36:08.497534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 51/97] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:08 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1502 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:08.665954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:08.666568 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:08.679789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.685500 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:08.686401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.697281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:08.812387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:08.812979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:08.827527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.835005 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:08.836800 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:08.837400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.014472 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.023781 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3b1b2e8-c60b-4166-bc37-655c0975cea3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.361374 May 31 22:36:09.025668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 47/98] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:08 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:09.148588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-dd162fb1-a98b-4ada-b185-23b9797af010 req-48f07ff8-5595-4356-a46c-b7554b38003b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:09.159493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dd162fb1-a98b-4ada-b185-23b9797af010 req-48f07ff8-5595-4356-a46c-b7554b38003b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.171492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dd162fb1-a98b-4ada-b185-23b9797af010 req-48f07ff8-5595-4356-a46c-b7554b38003b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.201743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-dd162fb1-a98b-4ada-b185-23b9797af010 req-48f07ff8-5595-4356-a46c-b7554b38003b service nova] Creating event network-changed:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:36:09.216093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-dd162fb1-a98b-4ada-b185-23b9797af010 req-48f07ff8-5595-4356-a46c-b7554b38003b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.187853 May 31 22:36:09.216719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 48/99] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:09.224964 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:09.226716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:09.230899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.239048 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.242410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.244028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.244585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.247325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6d35d8c5-2ff3-4fb1-b3fe-7341f35e25c3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.443332 May 31 22:36:09.248393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 52/100] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:08 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:09.254774 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-07d5a8ec-70f9-4e67-8a4b-3e6dd93f5ab8 req-1e0c721a-2ec0-49ac-8b02-3296d2aeeb97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60508e7-6ac1-4814-99ee-6e8d1d4e2057", "name": "network-vif-plugged", "status": "completed", "tag": "c597d8de-7087-4446-90e2-a5e14a1cda66"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:09.268802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-07d5a8ec-70f9-4e67-8a4b-3e6dd93f5ab8 req-1e0c721a-2ec0-49ac-8b02-3296d2aeeb97 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.275492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-07d5a8ec-70f9-4e67-8a4b-3e6dd93f5ab8 req-1e0c721a-2ec0-49ac-8b02-3296d2aeeb97 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.299771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-07d5a8ec-70f9-4e67-8a4b-3e6dd93f5ab8 req-1e0c721a-2ec0-49ac-8b02-3296d2aeeb97 service nova] Creating event network-vif-plugged:c597d8de-7087-4446-90e2-a5e14a1cda66 for instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 on hv-cinder-84414 May 31 22:36:09.313821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-07d5a8ec-70f9-4e67-8a4b-3e6dd93f5ab8 req-1e0c721a-2ec0-49ac-8b02-3296d2aeeb97 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064136 May 31 22:36:09.314629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 53/101] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:09.327789 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:09.329198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:09.335607 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.336159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.337179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:09.338064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:09.452353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.459896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fc9785af-887e-4c46-b84f-24027d3c57f8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.240166 May 31 22:36:09.460559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 49/102] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:09 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:09.555174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.564794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.567371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:09.568591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d80fe3a2-6e59-4871-baa0-098287b1f39a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.249560 May 31 22:36:09.569261 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 54/103] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:09 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:10.004757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-32b46323-0a58-400c-a718-17f8a8c0bf4d req-d3b31b5d-f707-4be8-aa48-2dc041728adf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bc3b11-0b60-4e5e-b594-f60d8c18c7bb", "tag": "c702999e-9047-4b64-a64b-1d6bc4baeab5"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:10.013607 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-32b46323-0a58-400c-a718-17f8a8c0bf4d req-d3b31b5d-f707-4be8-aa48-2dc041728adf service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.014262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-32b46323-0a58-400c-a718-17f8a8c0bf4d req-d3b31b5d-f707-4be8-aa48-2dc041728adf service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.027363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-32b46323-0a58-400c-a718-17f8a8c0bf4d req-d3b31b5d-f707-4be8-aa48-2dc041728adf service nova] Creating event network-changed:c702999e-9047-4b64-a64b-1d6bc4baeab5 for instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb on hv-cinder-84414 May 31 22:36:10.033455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-32b46323-0a58-400c-a718-17f8a8c0bf4d req-d3b31b5d-f707-4be8-aa48-2dc041728adf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033800 May 31 22:36:10.034627 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 50/104] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:10.041689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:10.042546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:10.050228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.051272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.052273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.053141 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.227094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.235063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a3d0b7d-e58d-4f81-8d45-ac4fd7719b38 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.198232 May 31 22:36:10.236225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 55/105] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:10 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:10.264608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:10.265393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:10.268202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:10.273897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.274421 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.275219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.275689 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.407843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.417628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-339cf6dd-8045-4f69-93bf-598b00b179d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.157354 May 31 22:36:10.418724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 51/106] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:10 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:10.476694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:10.477331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:10.479349 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:10.484418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.484872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.485640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.486083 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.587313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:10.588021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:10.597670 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.598118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.598925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:10.599355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:10.629253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.637666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-971e5a1f-1c45-4ff7-b80d-f8a4ca43e2e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.164864 May 31 22:36:10.638238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 56/107] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:10 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:10.735923 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.741971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=24 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:10.745150 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.746654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:10.747772 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b646f90e-2d7b-4c75-aa2d-b0c07943a9d5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.165013 May 31 22:36:10.748335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 52/108] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:10 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:11.252371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:11.252983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:11.257928 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=26 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:11.260390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.260841 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.261645 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.262079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.399346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.406984 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-de068d75-d165-4896-b056-9d24f162ab11 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.158846 May 31 22:36:11.407773 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 57/109] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:11 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:11.434799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:11.435424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:11.442316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.442757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.443548 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.443990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.572036 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.579508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dede92bd-a65f-4018-b4e7-cc4cf5aa6a7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.149122 May 31 22:36:11.580069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 53/110] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:11 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:11.654858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:11.655393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:11.664868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.665316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.666078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.666510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.765442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:11.766046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:11.767887 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=8 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:11.772557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.773832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.774620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:11.775207 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:11.793485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.801494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0e2fb049-0c51-4c94-874b-5662f2fc53e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.150519 May 31 22:36:11.809515 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 58/111] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:11 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:11.919002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.927133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.928679 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:11.929857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3ebad1e7-62dc-4f32-a4a3-deee6550b937 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.168262 May 31 22:36:11.930419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 54/112] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:11 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:36:12.424940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:12.425494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:12.432441 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.432889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.433649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.434088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.564830 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:12.572419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3c432885-2d83-47bd-83b0-336ced082be0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.151818 May 31 22:36:12.573361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:12 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:12.603546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:12.606485 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:12.615318 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.616146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.620848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.625423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.822319 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:12.823307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:12.833083 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.833667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.834387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.835013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.864683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:12.875526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-47544a52-1ada-4239-8aae-d5c1a74bcb31 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.282069 May 31 22:36:12.879722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 55/114] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:12 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:12.948092 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:12.948724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:12.954660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.955384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:12.956118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:12.956548 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.014515 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:13.022982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f7a320a5-3769-4036-ae1e-fa4cabb9c4c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.207691 May 31 22:36:13.024283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 60/115] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:12 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:13.098951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:13.101221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:13.108373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:13.110076 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:13.111185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e3b298e-8373-4bcb-8be3-c648d058b3cf tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.167257 May 31 22:36:13.111880 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 56/116] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:36:13.395383 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c076f667-838c-4c74-b952-a914d206db5a"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:13.396551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:13.406168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.406632 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.407842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.410320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.589716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:13.590550 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:13.596872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.597319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.598083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.598521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.750499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:13.760573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d6d51ce0-e36c-4af6-9de2-c81b0b6e6923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.175570 May 31 22:36:13.761154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 57/117] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:13 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:13.875753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:13.898052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:13.898872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:13.907019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.907636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:13.908409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:13.908850 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.174545 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.183534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-391d2d9e-4d9a-43be-a2f0-86d98d5e63cd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.290519 May 31 22:36:14.184895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 58/118] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:13 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:14.190112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:14.190988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:14.199544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.200268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.201201 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.201871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.426226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.434256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ac9c775b-fdc9-433f-8556-4c07417c9f87 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.248129 May 31 22:36:14.434828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 59/119] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:14 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:14.439197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:14.439791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:14.445543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.446177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.446969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.447604 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.586830 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8af64fb2-5a97-4a72-87aa-d976e0e2b84a tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "POST /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.194107 May 31 22:36:14.588631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 61/120] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:36:13 2022] POST /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5/os-volume_attachments => generated 194 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:14.655915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.665777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.667499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.668708 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e231bcd7-3c26-438f-93e9-f7ffa349c7f5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.232916 May 31 22:36:14.669364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 60/121] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:14 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:14.778725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:14.779722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:14.789892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.789892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.789892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.789892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.925586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:14.933555 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3bb421de-ee3f-47ee-9d39-1e49e57c3595 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.159830 May 31 22:36:14.944257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 62/122] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:14 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:14.946706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-4e8ac0be-ed87-43ab-8931-1d8363fb36bc req-c10a732d-7364-43bd-95b3-c5e3dfa0da5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d93938-cb2e-41e4-88b5-70bea066592f", "name": "network-vif-plugged", "status": "completed", "tag": "95f303ca-5d62-42f3-84df-9c81bf9bc698"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:14.955461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4e8ac0be-ed87-43ab-8931-1d8363fb36bc req-c10a732d-7364-43bd-95b3-c5e3dfa0da5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:14.956070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4e8ac0be-ed87-43ab-8931-1d8363fb36bc req-c10a732d-7364-43bd-95b3-c5e3dfa0da5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:14.968285 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-4e8ac0be-ed87-43ab-8931-1d8363fb36bc req-c10a732d-7364-43bd-95b3-c5e3dfa0da5e service nova] Creating event network-vif-plugged:95f303ca-5d62-42f3-84df-9c81bf9bc698 for instance 20d93938-cb2e-41e4-88b5-70bea066592f on hv-cinder-84414 May 31 22:36:14.973378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-4e8ac0be-ed87-43ab-8931-1d8363fb36bc req-c10a732d-7364-43bd-95b3-c5e3dfa0da5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044219 May 31 22:36:14.973975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 61/123] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:15.202655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:15.203432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:15.210506 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.211087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.211776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.212390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.347192 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:15.356044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-408ed222-22de-419b-a803-4f0d28345f66 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.158026 May 31 22:36:15.356964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 63/124] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:15 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:15.453757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:15.454713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:15.464492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.465014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.465706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.466310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.598035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:15.606137 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-890afcd7-272b-4dc9-8985-f53f421c2f19 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1367 microversion: 2.1 time: 0.157473 May 31 22:36:15.606691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 62/125] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:15 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:15.686958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:15.687561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:15.693455 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.693906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.694648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.695101 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.838548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:15.847899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:15.849467 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:15.850669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2fa0c2e7-a68a-46a9-baed-17e610ad5ccb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.167670 May 31 22:36:15.852624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 64/126] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:15 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:15.951269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:15.951878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:15.958043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.958486 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:15.959277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:15.959711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.093488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:16.105281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f08691c1-e350-4263-9036-5f49b8bcf4c8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.156659 May 31 22:36:16.105281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 63/127] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:15 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:16.373307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:16.374095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:16.381415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.381945 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.383260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.383698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.522551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:16.531103 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-154f07c2-9954-4828-b419-c7846e7db81d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.161603 May 31 22:36:16.531699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 65/128] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:16 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:16.623091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:16.624270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:16.630682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.631161 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.632194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.633382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.775154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:16.783457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9111a638-890f-4578-b10e-127212efad18 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1557 microversion: 2.1 time: 0.164498 May 31 22:36:16.793935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 64/129] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:16 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1557 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:16.805030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:16.809552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:16.816251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.817064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.817997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.821517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.881716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:16.883196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:16.894225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.894830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.897883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:16.901653 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:16.941277 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-62ea40a8-7c57-4e54-8484-43ab43a12ab4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141374 May 31 22:36:16.942273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 66/130] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:36:16 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:16.999014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-c5fc69d6-3568-47fa-a361-042da848da27 req-8e4b1863-4b70-4280-89b9-2636798b4fe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea73e6f2-f23d-4bab-9c42-3cd5ae60935d", "name": "network-vif-plugged", "status": "completed", "tag": "e01c4000-a281-4a40-86d1-800b7c862941"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:17.020659 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:17.026714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c5fc69d6-3568-47fa-a361-042da848da27 req-8e4b1863-4b70-4280-89b9-2636798b4fe0 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:17.029229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c5fc69d6-3568-47fa-a361-042da848da27 req-8e4b1863-4b70-4280-89b9-2636798b4fe0 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:17.058145 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-c5fc69d6-3568-47fa-a361-042da848da27 req-8e4b1863-4b70-4280-89b9-2636798b4fe0 service nova] Creating event network-vif-plugged:e01c4000-a281-4a40-86d1-800b7c862941 for instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d on hv-cinder-84414 May 31 22:36:17.063361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-c5fc69d6-3568-47fa-a361-042da848da27 req-8e4b1863-4b70-4280-89b9-2636798b4fe0 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068980 May 31 22:36:17.064208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 67/131] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:17.088819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:17.098010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:17.099738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:17.100889 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5cf5f4a0-7aef-4227-8f0a-eb8f759e4bd2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.235362 May 31 22:36:17.101985 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 65/132] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:16 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:36:17.121497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:17.122309 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:17.128633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:17.129377 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:17.130400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:17.131248 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:17.447347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:17.458364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2be3607e-a33f-4e3b-9cac-a67fa897dccf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.341513 May 31 22:36:17.461276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 68/133] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:17 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:17.548268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:17.548857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:17.554881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:17.555334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:17.556101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:17.556799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:17.709768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:17.739241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a34a0090-9a79-4210-959d-4597d15549aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.183088 May 31 22:36:17.739241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 66/134] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:17 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:18.120648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:18.121257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:18.127729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.128412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.129374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.129960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.431139 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:18.439663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:18.450636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:18.454855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ab350cd1-c010-43e0-8a55-a75b3fd7eae6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.339065 May 31 22:36:18.455845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 69/135] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:18 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:18.481431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:18.483433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:18.505187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.505187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.505714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.505884 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.681759 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:18.690225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dc9b59ef-4c58-4b94-a376-c3f2a702cebd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1321 microversion: 2.1 time: 0.217961 May 31 22:36:18.691023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 67/136] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:18 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:18.759762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-9b008982-39be-41b7-bf91-48df47b260fb req-482b4bf6-7d33-4440-b7dc-e83dda84c4ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c60508e7-6ac1-4814-99ee-6e8d1d4e2057", "tag": "c597d8de-7087-4446-90e2-a5e14a1cda66"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:18.760403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:18.772504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:18.814665 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.817410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.823514 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9b008982-39be-41b7-bf91-48df47b260fb req-482b4bf6-7d33-4440-b7dc-e83dda84c4ed service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.824143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9b008982-39be-41b7-bf91-48df47b260fb req-482b4bf6-7d33-4440-b7dc-e83dda84c4ed service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:18.825402 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:18.830418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.152483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:19.165227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9520be64-f8c3-4aee-ba72-6afd5d7fe679 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.423906 May 31 22:36:19.165827 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 70/137] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:18 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:19.239106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-9b008982-39be-41b7-bf91-48df47b260fb req-482b4bf6-7d33-4440-b7dc-e83dda84c4ed service nova] Creating event network-changed:c597d8de-7087-4446-90e2-a5e14a1cda66 for instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 on hv-cinder-84414 May 31 22:36:19.253740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-9b008982-39be-41b7-bf91-48df47b260fb req-482b4bf6-7d33-4440-b7dc-e83dda84c4ed service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.509595 May 31 22:36:19.258768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 68/138] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:19.431724 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-7d7cb5b2-123d-47cf-9296-73d930909b16 req-5301d0a8-bf40-477f-9d6f-125337c92dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "name": "network-vif-plugged", "status": "completed", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:19.442278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-7d7cb5b2-123d-47cf-9296-73d930909b16 req-5301d0a8-bf40-477f-9d6f-125337c92dd9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:19.442715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-7d7cb5b2-123d-47cf-9296-73d930909b16 req-5301d0a8-bf40-477f-9d6f-125337c92dd9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.456523 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-7d7cb5b2-123d-47cf-9296-73d930909b16 req-5301d0a8-bf40-477f-9d6f-125337c92dd9 service nova] Creating event network-vif-plugged:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:36:19.461922 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-7d7cb5b2-123d-47cf-9296-73d930909b16 req-5301d0a8-bf40-477f-9d6f-125337c92dd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035585 May 31 22:36:19.462727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 71/139] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:19.474090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:19.474941 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:19.482702 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:19.483312 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.483934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:19.484593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.716794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:19.721876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:19.722764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:19.729775 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:19.733179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:19.734426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8aa84b36-8dcf-4255-94bc-4a7705fa1388 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.264527 May 31 22:36:19.734963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 69/140] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:19 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:19.736453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:19.736909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.737988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:19.738434 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:19.996194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.015959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f4983f08-c996-426d-8aa2-25e5cffd29a3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1515 microversion: 2.1 time: 0.297913 May 31 22:36:20.017153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 72/141] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:19 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:20.034264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:20.035246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:20.042502 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.043803 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.044804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.045495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.126646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'flavor' on Instance uuid 20d93938-cb2e-41e4-88b5-70bea066592f {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:36:20.183656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:20.185658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:20.200390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.202088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.203197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.203775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.366753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.375157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-297261a5-11b1-4f7c-a027-53cef55400c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.197354 May 31 22:36:20.375736 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 73/142] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:20 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:20.528597 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9b2cef74-744d-4b9f-af31-1124a4127825 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f/action" status: 200 len: 32 microversion: 2.1 time: 0.497987 May 31 22:36:20.541134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:20.542300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:20.544207 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 70/143] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:36:20 2022] POST /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f/action => generated 32 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:36:20.557511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.558168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.560748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.568874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.753462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:20.754165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:20.780932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.791954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.794579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:20.798388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:20.842829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.851123 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1529a934-3815-4a1b-9dff-87484122a790 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.315494 May 31 22:36:20.852570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 74/144] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:20 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:20.987591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.996715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.998528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:20.999880 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a6a2baaa-c350-4618-864d-c37cd2e4bfcc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.250986 May 31 22:36:21.001149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 71/145] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:20 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:21.394033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:21.394646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:21.401152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:21.401603 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:21.402371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:21.402837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:21.478059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-4a04d994-ea9d-43af-bb66-a66b2772d6a5 req-4f9ca229-2eb0-4217-b98b-2f9a4394eb3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bc3b11-0b60-4e5e-b594-f60d8c18c7bb", "name": "network-vif-plugged", "status": "completed", "tag": "c702999e-9047-4b64-a64b-1d6bc4baeab5"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:21.490151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4a04d994-ea9d-43af-bb66-a66b2772d6a5 req-4f9ca229-2eb0-4217-b98b-2f9a4394eb3a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:21.490610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-4a04d994-ea9d-43af-bb66-a66b2772d6a5 req-4f9ca229-2eb0-4217-b98b-2f9a4394eb3a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:21.502871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-4a04d994-ea9d-43af-bb66-a66b2772d6a5 req-4f9ca229-2eb0-4217-b98b-2f9a4394eb3a service nova] Creating event network-vif-plugged:c702999e-9047-4b64-a64b-1d6bc4baeab5 for instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb on hv-cinder-84414 May 31 22:36:21.509367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-4a04d994-ea9d-43af-bb66-a66b2772d6a5 req-4f9ca229-2eb0-4217-b98b-2f9a4394eb3a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036238 May 31 22:36:21.509977 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 72/146] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:36:21.542234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:21.550268 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cb7a9d3c-31e8-493d-ab51-74533d2d97ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.160151 May 31 22:36:21.550870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 75/147] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:21 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:21.871279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:21.872311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:21.884861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:21.885756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:21.886739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:21.887303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:21.917043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:22.019232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:22.020156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:22.030199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:22.031421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:22.033241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:22.035036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:22.080337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:22.089910 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0b837967-ab23-4eb0-bf38-95df2366d923 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.224739 May 31 22:36:22.091004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 73/148] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:21 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:22.239844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:22.251594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:22.256121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:22.259018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b0f4eb5-73d2-411c-b233-1a2a4d93fab2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1407 microversion: 2.20 time: 0.244838 May 31 22:36:22.273664 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 76/149] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:22 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:36:22.567459 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:22.568064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:22.573945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:22.574387 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:22.575274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:22.575705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:22.705325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:22.718638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-67eb74b2-c086-4518-bab8-9c3b6875af26 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.154582 May 31 22:36:22.719081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 74/150] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:22 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:23.106253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:23.106919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:23.113427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.113868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.114628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.115109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.283838 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:23.288999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:23.307330 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:23.318199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.318199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.318393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-289b11fe-7a46-4188-98a2-2fdf67affc0e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.213041 May 31 22:36:23.321689 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.322095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 77/151] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:23 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:23.333313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.513981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:23.523849 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:23.542019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:23.542019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4cd8ef04-5990-4eab-8b75-a6100984f5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1599 microversion: 2.20 time: 0.253915 May 31 22:36:23.542019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 75/152] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:36:23 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1599 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:36:23.549461 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:23.550053 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:23.559213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.560174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.561641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.562745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.842861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-25f5b179-e5ff-411f-9642-80474207d28f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115493 May 31 22:36:23.842861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 78/153] 10.222.0.39 () {60 vars in 1315 bytes} [Tue May 31 22:36:23 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:36:23.843641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:23.843641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:23.843641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.843641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.844673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:23.844673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:23.879600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:23.887442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8cbd09d0-60a5-4c01-bcd0-c15d083147ef tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.155402 May 31 22:36:23.888051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 76/154] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:23 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:24.341913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:24.351774 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:24.353585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:24.354261 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:24.355536 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:24.356055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:24.377378 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:24.590594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:24.598493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa2637b4-a12b-40c7-94f7-93f173adbde9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.264739 May 31 22:36:24.599100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 79/155] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:24 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:24.904684 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:24.905338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:24.912634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:24.912634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:24.913035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:24.913695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.093766 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:25.101791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d66ad918-b21c-44a2-bef0-caa65ea1d693 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.201230 May 31 22:36:25.102656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 77/156] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:24 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:25.228842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-fd71c665-9617-4899-b4e7-e9a544e01a02 req-27a6f7fd-b34e-40b9-884d-0cee60ae7371 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:25.240498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fd71c665-9617-4899-b4e7-e9a544e01a02 req-27a6f7fd-b34e-40b9-884d-0cee60ae7371 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:25.241572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fd71c665-9617-4899-b4e7-e9a544e01a02 req-27a6f7fd-b34e-40b9-884d-0cee60ae7371 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.253938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-fd71c665-9617-4899-b4e7-e9a544e01a02 req-27a6f7fd-b34e-40b9-884d-0cee60ae7371 service nova] Creating event network-changed:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:36:25.259993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-fd71c665-9617-4899-b4e7-e9a544e01a02 req-27a6f7fd-b34e-40b9-884d-0cee60ae7371 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036518 May 31 22:36:25.261083 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 80/157] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:25.618068 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:25.618964 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:25.630204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:25.631211 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.632183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:25.632861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.829648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:25.842631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a8042f6b-9cd2-4880-a51f-db4b401b1246 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.231077 May 31 22:36:25.843797 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 78/158] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:25 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:25.856466 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:25.857635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:25.866906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:25.867488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.868559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:25.869035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:25.901449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:36:26.124615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:26.127493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:26.149487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.152854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:26.153976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.156524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:26.296879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3093203b-4e88-45ea-987f-bc87438a8f75 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "DELETE /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 204 len: 0 microversion: 2.1 time: 0.458385 May 31 22:36:26.297924 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 81/159] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:36:25 2022] DELETE /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:36:26.308694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:26.308694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:26.318288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.320382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:26.321522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.322030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:26.361829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:26.377999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b3cad4d-0bf2-47ff-8fa6-22456bc90eea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1361 microversion: 2.1 time: 0.258039 May 31 22:36:26.377999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:26 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:26.605749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:26.614215 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9943d59e-6745-468a-98c9-d010bce9d273 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1554 microversion: 2.1 time: 0.312129 May 31 22:36:26.615358 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 82/161] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:26 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1554 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:26.859578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:26.860260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:26.866378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.867486 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:26.868247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:26.868681 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.011429 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:27.019222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d197edc-e2e6-483e-bf33-095bb3601779 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.163527 May 31 22:36:27.019797 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 80/162] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:26 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:27.392663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:27.393295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:27.400971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.401411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.402230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.402659 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.556545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:27.564187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-29c4466d-fcd2-4d55-8bd2-f0b5645f78db tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1546 microversion: 2.1 time: 0.176111 May 31 22:36:27.564785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 83/163] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:27 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1546 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:27.582007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:27.582540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:27.589620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.590163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.591024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.591760 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.632266 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:27.633594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:27.639688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.640092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.641365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:27.641816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:27.669790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c115ad6-2689-4d85-980d-348499d199cb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091603 May 31 22:36:27.670377 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 81/164] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:36:27 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:27.792205 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:27.801109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2d008e73-e59c-4657-a4fb-bcac779b61d3 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1554 microversion: 2.1 time: 0.172830 May 31 22:36:27.801684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 84/165] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:27 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:28.036952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:28.038003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:28.044309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:28.044752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:28.045527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:28.045961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:28.308461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:28.319716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-33983b6e-02c4-4c33-87b5-1ced740086a1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.287796 May 31 22:36:28.320731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 82/166] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:28 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:28.818058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:28.818643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:28.825746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:28.826468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:28.827326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:28.827972 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:29.003830 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:29.015406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f5925853-9bf0-4a1e-ac28-7a2618bf836c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1554 microversion: 2.1 time: 0.201068 May 31 22:36:29.015986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 85/167] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:28 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1554 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:29.236919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-dfb228ad-e328-4607-a076-90c0a9141819 req-a9d54ecb-99f5-40f5-9f49-46a054ea1585 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14bc3b11-0b60-4e5e-b594-f60d8c18c7bb", "tag": "c702999e-9047-4b64-a64b-1d6bc4baeab5"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:29.250402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dfb228ad-e328-4607-a076-90c0a9141819 req-a9d54ecb-99f5-40f5-9f49-46a054ea1585 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:29.251073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-dfb228ad-e328-4607-a076-90c0a9141819 req-a9d54ecb-99f5-40f5-9f49-46a054ea1585 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:29.266195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-dfb228ad-e328-4607-a076-90c0a9141819 req-a9d54ecb-99f5-40f5-9f49-46a054ea1585 service nova] Creating event network-changed:c702999e-9047-4b64-a64b-1d6bc4baeab5 for instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb on hv-cinder-84414 May 31 22:36:29.277745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-dfb228ad-e328-4607-a076-90c0a9141819 req-a9d54ecb-99f5-40f5-9f49-46a054ea1585 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054008 May 31 22:36:29.278701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 83/168] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:29.341010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:29.341763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:29.350670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:29.351503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:29.356549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:29.356549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:29.525175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:29.533147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bdaf56f0-5648-4cd2-b484-3b2cdf5809bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.199474 May 31 22:36:29.534183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 86/169] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:29 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:30.042982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:30.043762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:30.050745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:30.051223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:30.052010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:30.052447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:30.202873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:30.215894 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-097e4599-2b8e-4f39-a272-05e7efa9be23 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1554 microversion: 2.1 time: 0.183391 May 31 22:36:30.223260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 84/170] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:30 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1554 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:30.549696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:30.550374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:30.560067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:30.561133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:30.562184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:30.563164 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:30.774287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:30.782124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c18aec9b-ef63-4dd8-9e98-291677241951 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.236285 May 31 22:36:30.792095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 87/171] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:30 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:31.230562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:31.231807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:31.242918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:31.243365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:31.244143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:31.244739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:31.535313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:31.563150 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0f5dfa3f-e5e2-4e12-b4fb-9a45e8111a2f tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1554 microversion: 2.1 time: 0.337034 May 31 22:36:31.563922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 85/172] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:31 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1554 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:31.798265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:31.798837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:31.807758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:31.808595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:31.809575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:31.810581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:32.311921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:32.321505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89e08572-49a5-4928-85c6-b21af419aa66 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.526985 May 31 22:36:32.322197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 88/173] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:31 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:32.544024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-3d1d9db8-ae01-4029-aaf6-eb4efa5b03f9 req-5e819516-1b22-4e64-8db7-ddfac2e9806b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25293baf-85ff-4dbd-8992-e106893eb7b5", "name": "network-vif-deleted", "tag": "b9325744-3e90-493c-b35c-0ea3530a2ff6"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:36:32.551925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-3d1d9db8-ae01-4029-aaf6-eb4efa5b03f9 req-5e819516-1b22-4e64-8db7-ddfac2e9806b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:32.552364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-3d1d9db8-ae01-4029-aaf6-eb4efa5b03f9 req-5e819516-1b22-4e64-8db7-ddfac2e9806b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:32.564156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-3d1d9db8-ae01-4029-aaf6-eb4efa5b03f9 req-5e819516-1b22-4e64-8db7-ddfac2e9806b service nova] Creating event network-vif-deleted:b9325744-3e90-493c-b35c-0ea3530a2ff6 for instance 25293baf-85ff-4dbd-8992-e106893eb7b5 on hv-cinder-84414 May 31 22:36:32.568998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-3d1d9db8-ae01-4029-aaf6-eb4efa5b03f9 req-5e819516-1b22-4e64-8db7-ddfac2e9806b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028661 May 31 22:36:32.569563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 86/174] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:36:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:36:32.581260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:32.581882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:32.587835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:32.588383 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:32.589075 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:32.589535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:32.654321 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:32.662433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6d5ef2bb-729f-425e-8186-a039d4a6c61d tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1512 microversion: 2.1 time: 0.084994 May 31 22:36:32.663064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 89/175] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:32 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1512 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:33.339971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:33.340683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:33.347421 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:33.348122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:33.348909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:33.349347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:33.500134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:33.508301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d1d7ff06-fb80-45c7-9661-1f3b2c5a5adc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.173529 May 31 22:36:33.508861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 87/176] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:33 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:33.681115 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:33.681969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:33.689135 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:33.689584 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:33.690380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:33.690834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:33.723511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:33.723964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:33.724426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lazy-loading 'fault' on Instance uuid 25293baf-85ff-4dbd-8992-e106893eb7b5 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:36:33.771669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9cd95bbe8024f028ae43eb6479b2a06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bdb186b8b2941d390fae360da76e6db', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:33.783024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d9e3f4a7-c1fe-4b6d-82e9-f37ede69bcb4 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 200 len: 1350 microversion: 2.1 time: 0.103120 May 31 22:36:33.783024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 90/177] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:33 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 1350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:34.526180 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:34.526180 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:34.532702 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:34.533160 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:34.533923 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:34.534361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:34.670957 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:34.678726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d4dcc31-a597-42c3-969c-21f558f6e89b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.157755 May 31 22:36:34.680099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 88/178] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:34 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:34.796631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:34.797239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:34.803617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:34.804062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:34.804822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:34.805261 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:34.820125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] HTTP exception thrown: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Request method failure captured: May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 HTTP/1.1 May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpguq_ZgF9LrKJb4-Yja_6LVHbNhmwcZesDbtqoXf7vgJMMd506knrDjHblX8qacNtfiYJ1uqtDe5tHtYieEvRzFiGyMVaCBoiju4KQ_qCo1j2icVeIzLvCo4mmb0wggVSQNX_Adb9QWV_tL_2RumgHhlygHEPh_qGJrojikCWF37DU May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:36:34.824692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bdb186b8b2941d390fae360da76e6db"}]}] May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: c9cd95bbe8024f028ae43eb6479b2a06 May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:34.826131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '25293baf-85ff-4dbd-8992-e106893eb7b5'} May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:36:34.827091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:34.828495 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:34.829687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Returning 404 to user: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:36:34.829687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d8203df1-50eb-41d9-8d8d-73d98f2012bd tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 404 len: 111 microversion: 2.1 time: 0.033296 May 31 22:36:34.829687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:34 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:36:35.095786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:35.096798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:35.102830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:35.103366 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:35.104201 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:35.104712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:35.118682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] HTTP exception thrown: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Request method failure captured: May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5/os-volume_attachments HTTP/1.1 May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpguq_ZgF9LrKJb4-Yja_6LVHbNhmwcZesDbtqoXf7vgJMMd506knrDjHblX8qacNtfiYJ1uqtDe5tHtYieEvRzFiGyMVaCBoiju4KQ_qCo1j2icVeIzLvCo4mmb0wggVSQNX_Adb9QWV_tL_2RumgHhlygHEPh_qGJrojikCWF37DU May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:36:35.123262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bdb186b8b2941d390fae360da76e6db"}]}] May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: c9cd95bbe8024f028ae43eb6479b2a06 May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:35.124695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '25293baf-85ff-4dbd-8992-e106893eb7b5'} May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:36:35.125577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:35.127005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:35.128504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Returning 404 to user: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:36:35.128504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0d7b96d2-f1ab-4099-a3c8-62312130b48c tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032915 May 31 22:36:35.128504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 89/180] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:36:35 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:36:35.696647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:35.697242 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:35.703550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:35.703993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:35.704759 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:35.705191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:35.886206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:35.893949 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-63bf84f5-6081-475b-a944-a4eb83df1901 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.201927 May 31 22:36:35.894838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:35 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:36.526274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:36.526822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:36.533007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.533459 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:36.534602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.534714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:36.548727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] HTTP exception thrown: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Request method failure captured: May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 HTTP/1.1 May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpguq_ZgF9LrKJb4-Yja_6LVHbNhmwcZesDbtqoXf7vgJMMd506knrDjHblX8qacNtfiYJ1uqtDe5tHtYieEvRzFiGyMVaCBoiju4KQ_qCo1j2icVeIzLvCo4mmb0wggVSQNX_Adb9QWV_tL_2RumgHhlygHEPh_qGJrojikCWF37DU May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:36:36.551004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bdb186b8b2941d390fae360da76e6db"}]}] May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: c9cd95bbe8024f028ae43eb6479b2a06 May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.552471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '25293baf-85ff-4dbd-8992-e106893eb7b5'} May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:36:36.553187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.554632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:36:36.556473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Returning 404 to user: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:36:36.556473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-83abc993-6ee9-4d39-b6e5-82098983cc94 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "DELETE /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 404 len: 111 microversion: 2.1 time: 0.030730 May 31 22:36:36.556473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 90/182] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:36:36 2022] DELETE /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:36:36.561190 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:36.561817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] [instance: 25293baf-85ff-4dbd-8992-e106893eb7b5] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:36.568119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.568970 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:36.570297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.570810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:36.586196 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] HTTP exception thrown: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Request method failure captured: May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 HTTP/1.1 May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpguq_ZgF9LrKJb4-Yja_6LVHbNhmwcZesDbtqoXf7vgJMMd506knrDjHblX8qacNtfiYJ1uqtDe5tHtYieEvRzFiGyMVaCBoiju4KQ_qCo1j2icVeIzLvCo4mmb0wggVSQNX_Adb9QWV_tL_2RumgHhlygHEPh_qGJrojikCWF37DU May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:36:36.587866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/2bdb186b8b2941d390fae360da76e6db"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_2bdb186b8b2941d390fae360da76e6db"}]}] May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 2bdb186b8b2941d390fae360da76e6db May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-DeleteServersTestJSON-1697602337 May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: c9cd95bbe8024f028ae43eb6479b2a06 May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-DeleteServersTestJSON-1697602337-project May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.589265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '25293baf-85ff-4dbd-8992-e106893eb7b5'} May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:36:36.593357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. May 31 22:36:36.595015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:36:36.596197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] Returning 404 to user: Instance 25293baf-85ff-4dbd-8992-e106893eb7b5 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:36:36.596197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a585fbd6-1a2d-4f9e-abcf-fc02aa00ba29 tempest-DeleteServersTestJSON-1697602337 tempest-DeleteServersTestJSON-1697602337-project] 10.222.0.39 "GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5" status: 404 len: 111 microversion: 2.1 time: 0.031913 May 31 22:36:36.596197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 93/183] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:36 2022] GET /compute/v2.1/servers/25293baf-85ff-4dbd-8992-e106893eb7b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:36:36.911037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:36.911736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:36.924932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.925463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:36.926269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:36.926855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:37.281564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:37.289169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6b0be7f6-7910-4ea9-96d0-60c9cf1bc80f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.382135 May 31 22:36:37.289751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 91/184] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:36 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:38.306514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:38.307163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:38.314034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:38.314485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:38.315482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:38.315805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:38.466907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:38.475778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5f4b6b39-42a8-433b-9487-51230ed89189 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.174043 May 31 22:36:38.477878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 94/185] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:38 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:39.501980 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:39.502665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:39.509345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:39.509892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:39.510800 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:39.511319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:39.647341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:39.654858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-01783927-6043-4ebf-a709-d042b0388fc8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.164395 May 31 22:36:39.666470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 92/186] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:39 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:40.673707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:40.674316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:40.681730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:40.682076 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:40.682900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:40.683331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:40.825430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:40.832895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f8c84f5-4139-4e92-9a6e-d0e71c397788 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.163418 May 31 22:36:40.833497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 95/187] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:40 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:41.849616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:41.850248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:41.856300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:41.856748 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:41.857498 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:41.857934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:41.861861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:41.987708 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:41.994719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b244c6d3-2f74-4329-807a-81f736df1cca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.149080 May 31 22:36:41.995320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 93/188] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:41 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:43.011581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:43.012195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:43.018854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:43.019252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:43.020022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:43.020464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:43.025061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:43.177017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:43.185513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-737ea70e-1b2c-4d21-8744-f199b43ddaca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.177636 May 31 22:36:43.186087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 96/189] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:43 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:44.204067 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:44.204671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:44.206537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=86 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:44.212144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:44.212595 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:44.213444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:44.213882 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:44.351501 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:44.359279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6eacbebd-bb48-4fcf-b56c-87fadbfe95d4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.159391 May 31 22:36:44.369189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 94/190] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:44 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:45.382657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:45.382657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:45.387099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:45.387535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:45.388309 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:45.388748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:45.536663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:45.548813 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0a137f8a-c7f8-41d5-835c-be36aa132321 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.175412 May 31 22:36:45.549651 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 97/191] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:45 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:46.574240 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:46.575508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:46.581523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:46.582197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:46.583200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:46.583808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:46.800209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:46.808577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-86fcf6c8-df52-41a8-a70a-e2b5bdfb4288 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.239015 May 31 22:36:46.809141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 95/192] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:46 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:47.832709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:47.833308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:47.840558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:47.841093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:47.841768 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:47.842203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:47.991909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:48.002995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-194be23a-82f1-4d26-ab57-4eda64ed42c6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.174204 May 31 22:36:48.013290 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 98/193] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:47 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:49.021507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:49.022472 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:49.029239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:49.029560 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:49.030425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:49.031069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:49.190210 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:49.198259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87de03e5-dc7d-4739-a1bf-ed9d8e9b2880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.181114 May 31 22:36:49.199094 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 96/194] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:49 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:50.215194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:50.216323 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:50.218825 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:36:50.225433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:50.225433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:50.225433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:50.226398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:50.421469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:50.430557 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b9c62128-9354-466e-8c42-656e4f42151a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.219629 May 31 22:36:50.432472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 99/195] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:50 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:51.450742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:51.450742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:51.464888 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:51.465341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:51.466116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:51.466546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:51.619114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:51.627658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-47eeca1c-c744-487c-a156-9ec2dc354279 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.183529 May 31 22:36:51.628247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 97/196] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:51 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:52.645260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:52.646724 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:52.654447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:52.655031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:52.655916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:52.656446 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:52.953256 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:52.961025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bd5a98bc-93c1-45d7-89f4-818cb5afccd6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.320271 May 31 22:36:52.961593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 100/197] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:52 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:53.977494 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:53.978101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:53.987847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:53.988952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:53.990662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:53.991950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:54.215502 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:54.225077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0797c7ad-915a-46a2-bc3f-2bdbe0a56103 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.251245 May 31 22:36:54.226700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 98/198] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:53 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:55.243897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:55.253436 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:55.253436 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:55.253436 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:55.254654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:55.255534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:55.783652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:55.796135 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ddf7da4b-1125-40fd-abde-ffcab704b5df tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.558376 May 31 22:36:55.809302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 101/199] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:55 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:36:56.820621 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:56.821403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:56.833474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:56.837002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:56.843176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:56.843176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:57.157768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:57.169737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d2eb5ab2-c099-4992-b061-e579c554fcfe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1521 microversion: 2.1 time: 0.353091 May 31 22:36:57.182549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 99/200] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:56 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:58.194220 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:58.198798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:58.226302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:58.226302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:58.227950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:58.229929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:58.560369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:58.569998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d524c13b-9c3c-4d90-972b-4bca2c216f99 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1501 microversion: 2.1 time: 0.383279 May 31 22:36:58.570596 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 102/201] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:58 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1501 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:36:58.589885 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:36:58.590499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:36:58.626571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:58.627362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:58.628256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:36:58.628704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:36:59.122911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:36:59.131651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2afeef0c-e38c-4380-9c8c-9b5799366822 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1514 microversion: 2.1 time: 0.547291 May 31 22:36:59.133060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 100/202] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:36:58 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1514 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:00.218021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1005115760", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "networks": [{"uuid": "3c832d96-0150-4a1b-8007-b4291f543173"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:00.344134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] validate_networks() for [('3c832d96-0150-4a1b-8007-b4291f543173', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:37:00.909117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:37:00.910080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:37:00.911242 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:37:00.911805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:37:00.912848 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:37:00.926262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:00.937908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:00.939279 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:00.941423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:01.000294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Getting quotas for project 7b4d8319cf5c4c9299d8e212e286df6a. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:01.026825 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Getting quotas for user aec2e49221754396968ec5df0f53525f and project 7b4d8319cf5c4c9299d8e212e286df6a. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:01.094401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:37:01.097739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:37:01.155006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:01.155980 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:01.177947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:01.178385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:01.179734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:01.180169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:01.229516 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'flavor' on Instance uuid ea73e6f2-f23d-4bab-9c42-3cd5ae60935d {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:37:01.322117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cb605825-9df3-4eb4-978f-0a456df6a349 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.111041 May 31 22:37:01.323802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 103/203] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:37:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:37:01.353829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5933d4bb-d80b-458d-b21b-2d99a973e47f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:01.354449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5933d4bb-d80b-458d-b21b-2d99a973e47f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:01.441099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5933d4bb-d80b-458d-b21b-2d99a973e47f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:01.448356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5933d4bb-d80b-458d-b21b-2d99a973e47f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1219 microversion: 2.1 time: 0.106513 May 31 22:37:01.448991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 104/204] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:01 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1219 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:01.681691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-318399cd-e377-4a55-802b-862b01ba8910 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/action" status: 200 len: 32 microversion: 2.1 time: 0.531163 May 31 22:37:01.681979 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 101/205] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:37:01 2022] POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/action => generated 32 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:37:01.699476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:01.700091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:01.724351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:01.724805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:01.726148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:01.728982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:02.471272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:02.481959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cf4b9cc-cd43-48f9-b6ed-ec18e6330a28 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:02.485560 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1cf4b9cc-cd43-48f9-b6ed-ec18e6330a28 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:02.494553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-01d81701-6405-4850-a528-2e219700b29d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.807110 May 31 22:37:02.496013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 105/206] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:01 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:02.682121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cf4b9cc-cd43-48f9-b6ed-ec18e6330a28 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:02.699420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1cf4b9cc-cd43-48f9-b6ed-ec18e6330a28 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1219 microversion: 2.1 time: 0.229021 May 31 22:37:02.700424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 102/207] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:02 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:03.517853 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:03.518737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:03.531510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:03.532098 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:03.537464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:03.539505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:03.722520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:03.723918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:03.744828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:03.744828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:03.744828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:03.745266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:03.921916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:03.935003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d9ff2fa5-dec2-4ade-9528-d08642ed0698 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1271 microversion: 2.1 time: 0.221442 May 31 22:37:03.935608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 103/208] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:03 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1271 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:04.176181 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:04.186924 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a44ad4fb-264c-486e-b00c-8a0480bce345 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.673012 May 31 22:37:04.191068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 106/209] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:03 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:04.953379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:04.954015 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:04.970051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:04.970716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:04.973948 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:04.974774 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:05.074871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:05.084591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-93a7dad3-def5-463c-a8cc-2bde8754a5a0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1277 microversion: 2.1 time: 0.135426 May 31 22:37:05.087819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 104/210] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:04 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1277 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:05.208097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:05.209756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:05.221729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:05.225832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:05.226888 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:05.227770 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:05.586449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:05.604366 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-54029c69-7a13-48a1-82cb-083fc9d8782b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.400545 May 31 22:37:05.613953 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 107/211] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:05 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:05.973996 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:05.974496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:05.981456 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:05.981911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:05.985271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:05.985271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:06.026551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82af608a-1b13-407d-a7fd-bef860829375 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/ips" status: 200 len: 149 microversion: 2.1 time: 0.061342 May 31 22:37:06.028005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 105/212] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:37:05 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:06.104085 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:06.105389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:06.120265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:06.121811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:06.136826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:06.137512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:06.402272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:06.434061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2432c3d7-c283-45df-b965-6d04edee109d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.334776 May 31 22:37:06.435416 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 108/213] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:06 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:06.621258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:06.622242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:06.637018 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:06.637709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:06.638677 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:06.639294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:06.933255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:06.942348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c2a9cda-dee7-4124-8490-ca4af6014575 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.324918 May 31 22:37:06.947581 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 106/214] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:06 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:07.451902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:07.452522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:07.463819 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:07.464270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:07.482929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:07.484723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:07.793315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:07.804279 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-52401ea6-dcfc-491e-8117-28ffb0bef5aa tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.354265 May 31 22:37:07.810652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 109/215] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:07 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:07.969848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:07.970369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:07.980314 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:07.980723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:07.981509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:07.981944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:08.071657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1386a4f-7269-42f9-86cf-3be2e6fe05a6"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:08.074589 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:08.088646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:08.095656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:08.098341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:08.102019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:08.333909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:08.355491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-962c36eb-75a0-4846-9a86-35b9bf280e1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.394560 May 31 22:37:08.363750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 107/216] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:07 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:08.680386 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-d337a988-9c96-4e9f-9606-13df3f87b151 req-f77de34b-624f-44da-8eca-fa2b825cd5f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bcf784e1-991c-4661-8d71-f0a9b262410e", "tag": "f739c0e7-71dc-482d-a0c5-4cc8bbfebe38"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:08.699243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d337a988-9c96-4e9f-9606-13df3f87b151 req-f77de34b-624f-44da-8eca-fa2b825cd5f2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:08.700491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d337a988-9c96-4e9f-9606-13df3f87b151 req-f77de34b-624f-44da-8eca-fa2b825cd5f2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:08.735173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-d337a988-9c96-4e9f-9606-13df3f87b151 req-f77de34b-624f-44da-8eca-fa2b825cd5f2 service nova] Creating event network-changed:f739c0e7-71dc-482d-a0c5-4cc8bbfebe38 for instance bcf784e1-991c-4661-8d71-f0a9b262410e on hv-cinder-84414 May 31 22:37:08.744428 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-d337a988-9c96-4e9f-9606-13df3f87b151 req-f77de34b-624f-44da-8eca-fa2b825cd5f2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068362 May 31 22:37:08.747713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 108/217] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:37:08.822216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:08.823249 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:08.830583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:08.831928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:08.833415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:08.834481 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:09.039838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f1db1158-b24c-4d92-ae75-a3a131a2186e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.976324 May 31 22:37:09.047579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 110/218] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:37:08 2022] POST /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 194 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:09.307537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:09.310230 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:09.318055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ec716823-33a0-4c03-8740-e4c66e7d4ae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.501661 May 31 22:37:09.319975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 109/219] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:08 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:09.384240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:09.385093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:09.435019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:09.437784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:09.438918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:09.440299 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:10.195921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:10.214678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6f8c82ea-0acb-4942-869b-721a21f4c463 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.837496 May 31 22:37:10.215484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 111/220] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:09 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:10.343501 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:10.344237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:10.364793 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:10.365331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:10.367455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:10.375086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:10.830023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:10.860084 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2d7ead7e-ab2a-47b9-ad66-573015f5ead4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.522324 May 31 22:37:10.861224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 110/221] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:10 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:11.232175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:11.232812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:11.235356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:11.244806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:11.252987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:11.254010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:11.254611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:11.447521 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=8 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:11.676481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:11.689468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa900725-a6af-4e68-abcb-d08192ad07f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.461298 May 31 22:37:11.692514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 112/222] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:11 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:11.883668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:11.883668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:11.899057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:11.900266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:11.905035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:11.905591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:12.424071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:12.435587 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c07b4d8e-c54f-49fd-988b-aa7ab9696c32 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.561809 May 31 22:37:12.439629 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 111/223] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:11 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:12.499222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:12.499843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:12.516801 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:12.517742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:12.523464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:12.523464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:12.536075 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:12.584405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-68cbc071-7fd6-49cb-80e0-18c9adce9b50 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/ips" status: 200 len: 151 microversion: 2.20 time: 0.090160 May 31 22:37:12.586368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 113/224] 10.222.0.39 () {60 vars in 1288 bytes} [Tue May 31 22:37:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/ips => generated 151 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:37:12.706471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:12.712729 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:12.717565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:12.731273 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:12.732116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:12.733695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:12.738084 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:13.037658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:13.058339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a8763705-17de-45de-a1d2-b351bc885c21 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.352704 May 31 22:37:13.059143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 112/225] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:12 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:13.457713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:13.458842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:13.469886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:13.473493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:13.474309 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:13.474745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:13.833515 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:13.841576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-973a2469-5ac9-4363-a956-f7af308d4a38 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.389407 May 31 22:37:13.842955 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 114/226] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:13 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:14.080580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:14.080580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:14.090863 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:14.095391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:14.096213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:14.096645 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:14.366652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:14.376825 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06817fb2-dc13-4343-a465-c713b4d3c64b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.305281 May 31 22:37:14.380860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 113/227] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:14 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:14.859817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:14.860571 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:14.876552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:14.882558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:14.884846 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:14.893018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:15.204328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:15.212090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9182f9a9-fc21-4dea-939a-0c97984fe2e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.356742 May 31 22:37:15.213243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 115/228] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:14 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:15.395381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:15.408850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:15.416484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:15.417307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:15.423287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:15.424585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:15.460345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f186375a-c36e-450f-9981-9cfc45bb70d3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Action: 'create', calling method: .version_select at 0x7ff45ede8ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-706992965", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOANiIXAF0C3fOai70Q0Q+WEYZ+ucEz9sOzhFVSBIohS2nWmuDMPzb42PeUtUlF3Rh6n5kSIMCTI7KoigR4e7hmHtCl+p5oi4aYSUtqUhsfBp1ptZMUgZw5rxBNWHiK9Ug=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:15.477354 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=42 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:15.529261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-f186375a-c36e-450f-9981-9cfc45bb70d3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Getting quotas for project 4d6702a00ff84f5b89028341f38f5e45. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:15.545816 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-f186375a-c36e-450f-9981-9cfc45bb70d3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Getting quotas for user 9c53e726c0e241e48a9ae68ba802abfc and project 4d6702a00ff84f5b89028341f38f5e45. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:15.708874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f186375a-c36e-450f-9981-9cfc45bb70d3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.509826 May 31 22:37:15.713152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:15.718641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 114/229] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:37:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:15.730241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6383b181-1812-4483-9599-25d3998deec7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.340597 May 31 22:37:15.733448 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 116/230] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:15 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:15.837897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:15.838652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:15.854073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:15.854854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:15.857902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:15.860666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:15.972523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3299391c-651a-48d1-94bc-a20f14022ef8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/ips" status: 200 len: 145 microversion: 2.1 time: 0.132310 May 31 22:37:15.974032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 115/231] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:37:15 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/ips => generated 145 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:16.062732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:16.063399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:16.075457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.075837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:16.076775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.077812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:16.123542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'flavor' on Instance uuid 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:37:16.230879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:16.232513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:16.256212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.259839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:16.261376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.261823 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:16.557563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:16.568283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-040d691a-835d-418d-b12a-224840b04398 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.342468 May 31 22:37:16.578912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 116/232] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:16 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:16.749541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:16.750948 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:16.760426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.761429 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:16.762413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:16.763243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:17.071851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:17.074720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-df1e4fb1-0f32-462a-b053-5600f1aaa880 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.329269 May 31 22:37:17.082973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 117/233] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:16 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:17.370309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-22d82bf6-f205-4c51-8752-e1147d27988d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: .version_select at 0x7ff45ede81f0>, body: {"keypair": {"name": "tempest-keypair-775277751", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMmMg41AEsyEZqSEcTVqTO3llZRFTZOXiU6RPTL5iQxSyb9Qz4wH6+FKcfkb9S8E+MOB/7+9l9mnYPDGuf4COCOs//+WJSWrnCqD1yISomFXrKvlqutA/2HZDJ1m7UfCmQ=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:17.412085 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-22d82bf6-f205-4c51-8752-e1147d27988d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:17.426609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-22d82bf6-f205-4c51-8752-e1147d27988d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:17.478715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b96fa761-fec8-4002-a2f9-027ccc14edc7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/action" status: 202 len: 0 microversion: 2.20 time: 1.418726 May 31 22:37:17.483355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 117/234] 10.222.0.39 () {62 vars in 1318 bytes} [Tue May 31 22:37:16 2022] POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/action => generated 0 bytes in 1426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 22:37:17.513723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:17.515789 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:17.525648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:17.528155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:17.528155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:17.528749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:17.632718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-22d82bf6-f205-4c51-8752-e1147d27988d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.264853 May 31 22:37:17.640753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 118/235] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:37:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:17.652857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:17.653461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:17.689361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:17.690077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:17.692959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:17.696109 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:17.900167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:17.911049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:17.913337 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:17.914575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-32b8a40b-0323-434e-9af1-ba1b2bece673 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.413962 May 31 22:37:17.916038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 118/236] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:17 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:18.093150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:18.093781 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:18.107604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:18.108063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:18.108857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:18.109295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:18.294868 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:18.306190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1ecd6a2f-6e31-4b49-b4d0-dea9087e2cd8 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.660599 May 31 22:37:18.311887 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 119/237] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:17 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:18.727978 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:18.736519 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3db74fb9-243c-41d5-85d2-5401a0a751fd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.647838 May 31 22:37:18.740430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 119/238] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:18 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:18.936822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:18.938972 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:18.958111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:18.961613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:18.962960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:18.963592 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.307804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:19.324501 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:19.327197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:19.327397 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:19.328229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:19.328934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a9302571-c1ce-4a7a-b529-98920ad0a59e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.398271 May 31 22:37:19.334330 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 120/239] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:18 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:19.349111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.349528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.377105 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.377583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.483037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9612a747-9fc7-4bff-bf94-61eccb98bdde"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:19.484253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:19.502073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.502969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.504032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.521428 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.829675 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:19.847376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fd2c1f14-8dd9-4206-a520-0bc9ce964c80 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.524216 May 31 22:37:19.859981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 120/240] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:19 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:19.866821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:19.868041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:19.880292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.880292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:19.880292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:19.880292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:20.269509 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:20.314484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a1449cc-b13e-49cf-9a05-20c7a5007f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.453174 May 31 22:37:20.329721 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 121/241] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:19 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:20.353172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-e8dfac06-ab02-4d6b-9050-a70d55198863 req-b303fbbe-003f-44b4-b95e-b104cb7c539b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf784e1-991c-4661-8d71-f0a9b262410e", "name": "network-vif-plugged", "status": "completed", "tag": "f739c0e7-71dc-482d-a0c5-4cc8bbfebe38"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:20.390572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-e8dfac06-ab02-4d6b-9050-a70d55198863 req-b303fbbe-003f-44b4-b95e-b104cb7c539b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:20.396445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-e8dfac06-ab02-4d6b-9050-a70d55198863 req-b303fbbe-003f-44b4-b95e-b104cb7c539b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:20.439484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-e8dfac06-ab02-4d6b-9050-a70d55198863 req-b303fbbe-003f-44b4-b95e-b104cb7c539b service nova] Creating event network-vif-plugged:f739c0e7-71dc-482d-a0c5-4cc8bbfebe38 for instance bcf784e1-991c-4661-8d71-f0a9b262410e on hv-cinder-84414 May 31 22:37:20.467832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-e8dfac06-ab02-4d6b-9050-a70d55198863 req-b303fbbe-003f-44b4-b95e-b104cb7c539b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134353 May 31 22:37:20.476088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 122/242] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:20.501346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:20.502172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:20.522790 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:20.539490 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:20.540339 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:20.546871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:20.970329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:20.981178 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:20.983161 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:20.985156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c511173-7d4a-41b2-b0c6-7eb7a0a9fea5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.507827 May 31 22:37:20.994409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 123/243] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:20 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:20.999518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-03b258f4-8690-484b-a2d6-c3381a61968e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.526008 May 31 22:37:21.000659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 121/244] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:37:19 2022] POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments => generated 194 bytes in 1528 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:21.006918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:21.019493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:21.032546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:21.033006 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:21.033805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:21.034245 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:21.337677 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:21.338386 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:21.358540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:21.359020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:21.363089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:21.370285 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:21.415389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:21.436769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-53b39b9d-8d05-42c7-a22a-d2d0cc937831 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.440685 May 31 22:37:21.456631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 124/245] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:20 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:21.684348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:21.700645 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bb0fbccc-2340-436e-9710-d85c0899620b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.367489 May 31 22:37:21.703751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 122/246] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:21 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:22.008757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:22.008757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:22.011589 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.012038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.012808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.013246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.143409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:22.154101 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:22.155931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:22.158649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4f37a6bd-33bc-4762-9b22-512f54db59ca tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.158205 May 31 22:37:22.159695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 125/247] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:21 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:22.459704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:22.460682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:22.473170 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.476038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.476869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.477313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.731481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:22.732092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:22.744117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.750698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.750698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:22.750698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:22.848778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:22.883435 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-957eb775-c8dc-46b5-9ae9-2bd98ee80f7d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1319 microversion: 2.1 time: 0.425994 May 31 22:37:22.893255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 123/248] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:22 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1319 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:23.029921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:23.056015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a9721c5b-5804-4405-af25-dbbe5ab12db6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1500 microversion: 2.1 time: 0.330136 May 31 22:37:23.057136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 126/249] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:22 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1500 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:23.074294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "754ada68-2dd3-4ad1-a607-658888c0958d"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:23.075808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:23.098874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.099545 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.100632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.101234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.176635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:23.181498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:23.181498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:23.193217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.193670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.195118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.195558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] HTTP exception thrown: Cannot 'attach_volume' instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d while it is in vm_state rescued May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Request method failure captured: May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/os-volume_attachments HTTP/1.1 May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 74 May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphEmgsIR1PKebLwbTtBv5_bGKBIdJ1FudIYqAYv6Vl-hTQfQ6sgLA1jR7riu4CBMrTlO6YycpQS0G6A7mBg-mchauL_8g5fI7qA4jCLL7etM7QnSywfyKnssNi5Q5YMi0dsrBZH_HE3JXWt4ID4o9VFrtV4yqyKJLwtFfNUYOTe2FM May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: dbc9abb548994abba42919b7d850be0b May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:37:23.242374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dbc9abb548994abba42919b7d850be0b"}]}] May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: dbc9abb548994abba42919b7d850be0b May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 0a5a154e334e49db92d41cefaf75ef27 May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {"volumeAttachment": {"volumeId": "754ada68-2dd3-4ad1-a607-658888c0958d"}} May 31 22:37:23.243811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Cannot 'attach_volume' instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d while it is in vm_state rescued May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'server_id': 'ea73e6f2-f23d-4bab-9c42-3cd5ae60935d', 'body': {'volumeAttachment': {'volumeId': '754ada68-2dd3-4ad1-a607-658888c0958d'}}} May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d in vm_state rescued. Cannot attach_volume while the instance is in this state. May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:37:23.244533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d while it is in vm_state rescued May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:37:23.249270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d while it is in vm_state rescued May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Returning 409 to user: Cannot 'attach_volume' instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d while it is in vm_state rescued {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-035850f6-39e3-4b86-ac47-5176cd2640ec tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.173092 May 31 22:37:23.251305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 124/250] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:37:23 2022] POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/os-volume_attachments => generated 152 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 31 22:37:23.257056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:23.257241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:23.285840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.292690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.293485 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.293943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.574542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:23.584327 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:23.587386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:23.591645 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fa7f81f0-3f3a-49f3-9a23-9344480733b5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.417680 May 31 22:37:23.595752 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 127/251] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:23 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:23.601744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1543340382", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a18a0f-17f5-48fc-adf9-abe14bc8b4bd"}], "security_groups": [{"name": "tempest-securitygroup--944146648"}], "key_name": "tempest-keypair-775277751", "user_data": "}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:23.783733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0d9bea94-146c-444c-8f74-6a54312124dd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/action" status: 202 len: 0 microversion: 2.1 time: 0.533751 May 31 22:37:23.787475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 125/252] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:37:23 2022] POST /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d/action => generated 0 bytes in 538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:37:23.794533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:23.800504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:23.820953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.821926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:23.823003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:23.835077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:24.121176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:24.124546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:24.131317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0196a36b-908a-46bc-b16b-0dbbcfbece4b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1508 microversion: 2.1 time: 0.341713 May 31 22:37:24.141954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 126/253] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:23 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:24.147565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:24.148385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:24.155643 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:24.156300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:24.157222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:24.157824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:24.473450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:24.493778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e6e5ba59-a6b2-4105-8584-1672b9a6814c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1508 microversion: 2.1 time: 0.348132 May 31 22:37:24.495409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 127/254] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:24 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1508 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:24.613458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:24.614338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:24.637280 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:24.637752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:24.638610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:24.639064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:24.896741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:24.907930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:24.920244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:24.929020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ecb5a58a-0cef-41f5-a3f0-f1ecf43b6275 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.319281 May 31 22:37:24.930307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 128/255] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:24 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:25.148723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:25.149475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:25.157169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:25.157761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:25.158809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:25.159359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:25.313444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:25.326820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eaf875bb-79dd-4547-932b-15f358aaef1c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1508 microversion: 2.1 time: 0.181901 May 31 22:37:25.328089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 129/256] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:25 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:25.948676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:25.950317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:25.960809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:25.961499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:25.962484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:25.963138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:26.151296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:26.160575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:26.163507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:26.164926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dc515217-4990-4840-b1c6-783ff3fd014e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.220628 May 31 22:37:26.166538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 130/257] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:25 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:26.345892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:26.347060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:26.495787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:26.496695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:26.497856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:26.498444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:26.755229 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:26.766728 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-467c036e-90a1-4aca-a430-ed1575c6eab7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1508 microversion: 2.1 time: 0.425434 May 31 22:37:26.771366 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 131/258] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:26 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1508 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:27.187182 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:27.187863 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:27.195335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:27.195847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:27.196845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:27.197288 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:27.351540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:27.363651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:27.365394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:27.366724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3c75e403-06e1-4a3d-aadf-73d0148db19c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.183890 May 31 22:37:27.367664 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 132/259] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:27 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:27.787986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:27.790113 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:27.792005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=8 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:27.797193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:27.797832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:27.798798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:27.799400 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:28.003025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:28.012260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2d37f69c-7e48-40c4-9828-bf883f2579d9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1514 microversion: 2.1 time: 0.228072 May 31 22:37:28.013127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 133/260] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:27 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1514 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:28.386053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:28.386693 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:28.401683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:28.402478 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:28.404804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:28.411389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:28.590367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:28.607331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:28.609637 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:28.611096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-05763dd1-90c0-4379-abd8-28c8939e40ac tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.229072 May 31 22:37:28.633023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 134/261] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:28 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:29.637731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:29.639543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:29.649906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:29.650687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:29.651691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:29.652533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:29.833918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:29.844844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:29.846373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:29.847586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ecc0a924-03e9-407e-873c-d539f24eabb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.214420 May 31 22:37:29.848154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 135/262] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:29 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:29.858550 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-596a3215-45f6-47da-90f6-b017353d7023 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: .version_select at 0x7ff45ede2f70>, body: {"keypair": {"name": "tempest-keypair-1682099172", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvWxs9M39bkFeNsWzKbNFzHkyAmg39q8pJLp87jxV6634pli128oytMxsrclc4JAw5cFc2309re9/D1unvD4YYnMlqRpWQ72dHGNQLzQscCrHn1Dn9rKqJltlU1rhoYjw=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:29.877244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-596a3215-45f6-47da-90f6-b017353d7023 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for project dbc9abb548994abba42919b7d850be0b. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:29.884969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-596a3215-45f6-47da-90f6-b017353d7023 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for user 0a5a154e334e49db92d41cefaf75ef27 and project dbc9abb548994abba42919b7d850be0b. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:30.050364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-596a3215-45f6-47da-90f6-b017353d7023 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.199884 May 31 22:37:30.052473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 136/263] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:37:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:30.866328 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:30.867716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:30.874933 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:30.875605 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:30.876385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:30.876988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:31.112958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:31.132339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:31.132339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:31.132339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2679e67a-0005-4aa2-848c-2429760709ec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.262040 May 31 22:37:31.132686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 137/264] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:30 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:31.132686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b8a3d208-2e85-444f-887d-88dafd06d73d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:31.135153 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8a3d208-2e85-444f-887d-88dafd06d73d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:31.135598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8a3d208-2e85-444f-887d-88dafd06d73d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:31.210817 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b8a3d208-2e85-444f-887d-88dafd06d73d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Going to try to stop instance {{(pid=124590) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 22:37:31.496111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b8a3d208-2e85-444f-887d-88dafd06d73d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.370642 May 31 22:37:31.496697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 138/265] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:37:31 2022] POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:37:31.505118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:31.505692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:31.512631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:31.513261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:31.522696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:31.522696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:31.651709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:31.659946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b131afc7-6ba7-4dc3-ac2c-15f53fea86b5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.159024 May 31 22:37:31.660598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 139/266] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:31 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:31.758990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41312720-9cde-43d8-b463-7b0973e651aa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'create', calling method: .version_select at 0x7ff45eeeef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-705323056", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG4ToJY4wGAVKq6ZmpxEefCE4fCNFVELaA6q2wdg94+PTXvlzHaZWw1t2Wnq2XRrrRhSlsEvzlXb8kSymbzuehRFLtco7rn19PcZhKz/kS9bYOXOV+KLAuq+ibNaBSlQyQ=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:31.775307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-41312720-9cde-43d8-b463-7b0973e651aa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Getting quotas for project 411823fbbfc24cbf94dc4aff1129889f. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:31.785423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-41312720-9cde-43d8-b463-7b0973e651aa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Getting quotas for user 7ad64b6793124cc9b4a5a315cb1aa56a and project 411823fbbfc24cbf94dc4aff1129889f. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:31.890305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41312720-9cde-43d8-b463-7b0973e651aa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.135761 May 31 22:37:31.891402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 140/267] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:37:31 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:37:32.026998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] validate_networks() for [('10a18a0f-17f5-48fc-adf9-abe14bc8b4bd', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:37:32.069562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-352159518", "imageRef": "b5e63f22-66f7-4894-9731-11efc44f155f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-705323056", "networks": [{"uuid": "55220f1a-5038-490a-b312-cf1f95983a7f"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:32.187301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] validate_networks() for [('55220f1a-5038-490a-b312-cf1f95983a7f', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:37:32.510646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:37:32.511098 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:37:32.511564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:37:32.511992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:37:32.512449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:37:32.522412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.522885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:32.523745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.524177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:32.556496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:32.561016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:32.572381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:37:32.574673 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:37:32.696609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-de3c342e-5dde-469a-a705-10053ee3ba6e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 9.099452 May 31 22:37:32.697272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 128/268] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:37:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 9101 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:37:32.702077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:32.703138 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:32.717731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.718430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:32.725737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.725737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:32.748731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:32.936697 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:32.962252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:32.963785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:32.964957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4f99596c-6fae-4cad-adf9-5627678c35a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.266544 May 31 22:37:32.965504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 129/269] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:32 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:32.973013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:32.973626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:32.989831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.989831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:32.989831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:32.989831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:33.009871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:37:33.010364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:37:33.010845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:37:33.011279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:37:33.011694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:37:33.023177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:33.023628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:33.026329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:33.026329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:33.037110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:33.043196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Getting quotas for project 411823fbbfc24cbf94dc4aff1129889f. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:33.047436 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Getting quotas for user 7ad64b6793124cc9b4a5a315cb1aa56a and project 411823fbbfc24cbf94dc4aff1129889f. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:33.059367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:37:33.062439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='b5e63f22-66f7-4894-9731-11efc44f155f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:37:33.171407 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-620adc61-6960-4811-a9f0-9853e8b08c2f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.106197 May 31 22:37:33.172361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 141/270] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:37:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1108 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:37:33.186358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2fd25c79-0069-4e52-a378-b7a0af20d4c6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:33.186358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2fd25c79-0069-4e52-a378-b7a0af20d4c6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:33.198579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:33.207999 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-19dd52a2-621a-479e-a520-7f18ff279893 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.239724 May 31 22:37:33.208808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 130/271] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:32 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:33.216658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a0b671d-d719-4e24-86e2-9a06becc803c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:33.217580 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a0b671d-d719-4e24-86e2-9a06becc803c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:33.281485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a0b671d-d719-4e24-86e2-9a06becc803c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:33.291083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2fd25c79-0069-4e52-a378-b7a0af20d4c6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:33.303958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2fd25c79-0069-4e52-a378-b7a0af20d4c6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1241 microversion: 2.1 time: 0.125060 May 31 22:37:33.304351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a0b671d-d719-4e24-86e2-9a06becc803c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1257 microversion: 2.1 time: 0.090342 May 31 22:37:33.304438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 142/272] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:33 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1241 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:33.304516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 131/273] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:33 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1257 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:33.807569 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2065464039", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aa326e9b-c8ca-45b9-8e5f-fbba99d36365"}], "security_groups": [{"name": "tempest-securitygroup--2096716413"}], "key_name": "tempest-keypair-1682099172", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:33.983159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:33.983760 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:33.990153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:33.990595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:33.991484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:33.991917 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.132696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.141237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.144926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.144926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2cbaa803-1ccc-442b-bff3-db44011d7402 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.165029 May 31 22:37:34.144926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 132/274] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:33 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:34.229297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:34.230009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:34.236200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.236644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.237409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.237838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.376759 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.385292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-283e74f4-3390-4f00-8115-8ed31826ca75 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.163406 May 31 22:37:34.385864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 133/275] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:34 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:34.397251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:34.398483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:34.404551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.405329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.405829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.406263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.474162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.482870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-92fdd345-4cce-4d43-9705-b2109aee9d1c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1237 microversion: 2.1 time: 0.095811 May 31 22:37:34.483900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 134/276] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:34 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1237 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:34.488708 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:34.489478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:34.495923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.501991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.501991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.501991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.542131 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] validate_networks() for [('aa326e9b-c8ca-45b9-8e5f-fbba99d36365', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:37:34.563902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:34.572990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cdcaa772-c876-42f0-a7d9-45938fcf34be tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1261 microversion: 2.1 time: 0.087809 May 31 22:37:34.575441 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 135/277] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:34 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1261 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:34.933846 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:37:34.934375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:37:34.934891 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:37:34.935310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:37:34.935730 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:37:34.944406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.945480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.946282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:34.946721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:34.963641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:37:34.967674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Getting quotas for user 0a5a154e334e49db92d41cefaf75ef27 and project dbc9abb548994abba42919b7d850be0b. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:37:34.979848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:37:34.981975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:37:35.125891 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6a9fcd8b-5ada-4d46-9450-04e211de91ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.323892 May 31 22:37:35.126552 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 143/278] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:37:33 2022] POST /compute/v2.1/servers => generated 409 bytes in 1325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:37:35.136718 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-542f636f-9974-41ab-a6b4-d5d2ec8634ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:35.137624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-542f636f-9974-41ab-a6b4-d5d2ec8634ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:35.165939 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:35.166555 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:35.173375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.175361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.175361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.175603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.205202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-542f636f-9974-41ab-a6b4-d5d2ec8634ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.213015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-542f636f-9974-41ab-a6b4-d5d2ec8634ae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1246 microversion: 2.1 time: 0.080050 May 31 22:37:35.215856 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 136/279] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:35 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1246 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:35.351822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.360327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.362010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.363199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b60c5e0-25b5-48b5-b003-688d94bacb93 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.203349 May 31 22:37:35.363759 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 144/280] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:35 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:35.403431 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:35.404240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:35.411459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.412187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.413118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.414420 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.500326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:35.500939 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:35.506986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.507470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.508241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.508678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.582383 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.590027 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cce13f96-fbee-4391-a94a-c72bb1d9353e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1301 microversion: 2.1 time: 0.093358 May 31 22:37:35.590770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 145/281] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:35 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:35.602401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.607896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:35.608510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:35.611899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-29ff676c-935e-4e8d-bd3a-25efdd872864 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.212227 May 31 22:37:35.612476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 137/282] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:35 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:35.615754 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.616410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.618283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:35.618394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:35.683335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:35.685525 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:35.691482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a0698bef-6c0e-45bd-a01e-72f390a2ceef tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1309 microversion: 2.1 time: 0.087646 May 31 22:37:35.692053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 146/283] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:35 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:36.239638 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:36.240798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:36.249593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.250034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.250867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.251298 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.370798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.381636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a2a2884-000a-4698-ab8d-0fbfb6682206 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1250 microversion: 2.1 time: 0.151298 May 31 22:37:36.382845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 138/284] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:36 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1250 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:36.393378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:36.394336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:36.403353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.403956 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.404802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.405306 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.545902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.556381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.558031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.560370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e085f214-8c34-4f2e-8fb9-f87fa6da5251 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.181613 May 31 22:37:36.561207 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 147/285] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:36 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:36.607273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:36.612926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:36.616528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.617054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.617953 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.618589 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.634988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:36.639165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:36.642525 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.643315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.644551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.645005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.721312 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.736131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-58f32ba2-6239-4ca9-a7d2-29a7374431e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1299 microversion: 2.1 time: 0.132693 May 31 22:37:36.736722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 139/286] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:36 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:36.741412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:36.742399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:36.749388 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.750119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.751136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:36.751771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:36.790884 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.798836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dd4e5683-8ff5-4474-a3af-5b0647f6efc7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.169297 May 31 22:37:36.799530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 148/287] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:36 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:36.840363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:36.847983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b36a8785-6cab-4554-a847-7e2a685ef28b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1315 microversion: 2.1 time: 0.110069 May 31 22:37:36.849047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 140/288] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:36 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1315 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:37.401236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:37.402411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:37.411994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.412468 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.413842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.414339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.511290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:37.519616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-481a0ef0-c65c-4053-95f6-6ed34770a667 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1306 microversion: 2.1 time: 0.124072 May 31 22:37:37.520192 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 149/289] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:37 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1306 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:37.579062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:37.579948 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:37.588355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.589069 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.589995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.590576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.753289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:37.754657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:37.761621 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.762287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.763101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:37.763539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:37.972284 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:37.985844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:37.985987 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:37.986094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:37.986094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-35ba1839-6bdc-44d8-b555-e65b496999ef tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.410850 May 31 22:37:37.986892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 141/290] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:37 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:38.001462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:38.003180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:38.006836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-378572f8-e308-4bb6-8d7f-90541a4e1856 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.257393 May 31 22:37:38.008183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 150/291] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:37 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:38.012875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:38.013740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:38.016290 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.016762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.017533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.017979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.020810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.021486 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.023689 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.024220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.261384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:38.283339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eeb9848f-3a45-4958-b057-3a597ab72a21 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.271883 May 31 22:37:38.284776 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 151/292] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:38 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:38.413017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:38.426582 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5199dd4a-acfa-4cdd-948c-17c5926e6271 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.438079 May 31 22:37:38.428091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 142/293] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:37 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:38.539138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:38.540055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:38.553543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.557599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.558892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.559095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.721408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:38.736195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-40b1cfd7-232c-40f3-aed7-0a1c75f928c0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.200204 May 31 22:37:38.738499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 152/294] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:38 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:38.825238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-3a2c9a85-55c0-4e3f-880c-a37081bda632 req-72079a92-6e82-4d54-a925-7a20ffea1798 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20693ef7-74d7-4abb-8e36-5390380de3c8", "tag": "3e1b5caa-a076-4fff-93dc-cba5f814d2bc"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:38.837816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3a2c9a85-55c0-4e3f-880c-a37081bda632 req-72079a92-6e82-4d54-a925-7a20ffea1798 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:38.838010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-3a2c9a85-55c0-4e3f-880c-a37081bda632 req-72079a92-6e82-4d54-a925-7a20ffea1798 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:38.851249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-3a2c9a85-55c0-4e3f-880c-a37081bda632 req-72079a92-6e82-4d54-a925-7a20ffea1798 service nova] Creating event network-changed:3e1b5caa-a076-4fff-93dc-cba5f814d2bc for instance 20693ef7-74d7-4abb-8e36-5390380de3c8 on hv-cinder-84414 May 31 22:37:38.858712 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-3a2c9a85-55c0-4e3f-880c-a37081bda632 req-72079a92-6e82-4d54-a925-7a20ffea1798 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038744 May 31 22:37:38.868223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 143/295] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:37:39.007232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:39.011321 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:39.026419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:39.027811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:39.035323 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.036174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.037149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.037754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.041484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.042023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.044411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.057357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.402532 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.406082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.411059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9238058e-61c3-45d5-8d6a-4f6b138ae65f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.389576 May 31 22:37:39.415407 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 144/296] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:39 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:39.419078 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.420589 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.421766 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5de4f72c-2ccf-4475-a0d5-9d6a7f6fe32d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1744 microversion: 2.20 time: 0.420349 May 31 22:37:39.422599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 153/297] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:39 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1744 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:39.426977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:39.427674 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:39.435007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.435467 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.436229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.436798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.446376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:39.447111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:39.454409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.454973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.455970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.456487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.715528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.737276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4e1d8b51-a8e4-4313-bbdc-3083f10d35ea tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.289316 May 31 22:37:39.737276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 154/298] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:39 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:39.759773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:39.760396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:39.766429 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.766965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.767736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:39.768167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:39.769994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.778036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-815caaea-16a8-49e8-a8c3-a45b8ac27aa6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.361267 May 31 22:37:39.779179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 145/299] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:39 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:39.958324 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:39.967813 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4dbdc7ca-0aa8-44ff-b1be-cddf2a32fb23 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.215669 May 31 22:37:39.968625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 155/300] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:39 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:40.047727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-2dc8d0d1-25ef-43c2-bec2-634e83803747 req-143be8f9-9e44-472e-b7c0-2897ae2d016a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:40.068025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2dc8d0d1-25ef-43c2-bec2-634e83803747 req-143be8f9-9e44-472e-b7c0-2897ae2d016a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.068552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2dc8d0d1-25ef-43c2-bec2-634e83803747 req-143be8f9-9e44-472e-b7c0-2897ae2d016a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.088822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-2dc8d0d1-25ef-43c2-bec2-634e83803747 req-143be8f9-9e44-472e-b7c0-2897ae2d016a service nova] Creating event network-changed:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:37:40.096080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-2dc8d0d1-25ef-43c2-bec2-634e83803747 req-143be8f9-9e44-472e-b7c0-2897ae2d016a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052609 May 31 22:37:40.098021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 146/301] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:37:40.428722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:40.429918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:40.436577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.437274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.438213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.438829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.442486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:40.443320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:40.451095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.451473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.452618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.453062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.680059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:40.688717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:40.690245 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:40.691647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4c8fb405-3ee1-46e4-a19f-d5dcbb173710 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1744 microversion: 2.20 time: 0.253956 May 31 22:37:40.692207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 147/302] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:40 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1744 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:37:40.750283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:40.751417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:40.760223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.760769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.761636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.762144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.883739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:40.892086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1eac7526-f677-434d-8f2f-c4871057539c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.467477 May 31 22:37:40.892658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 156/303] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:40 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:40.897169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:40.898461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:40.904536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.904978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.905734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.906171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.911915 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:40.921668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7fbe7036-b204-4225-a9ed-3a2ded6493f1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.176000 May 31 22:37:40.936806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 148/304] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:40 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:40.942366 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-da725e6a-a9c0-4c01-8866-22f6c1ff87c8 req-9dd5c0e8-eeba-441b-9489-8bb823c5da56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:40.954817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-da725e6a-a9c0-4c01-8866-22f6c1ff87c8 req-9dd5c0e8-eeba-441b-9489-8bb823c5da56 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.955513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-da725e6a-a9c0-4c01-8866-22f6c1ff87c8 req-9dd5c0e8-eeba-441b-9489-8bb823c5da56 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.967795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-da725e6a-a9c0-4c01-8866-22f6c1ff87c8 req-9dd5c0e8-eeba-441b-9489-8bb823c5da56 service nova] Creating event network-changed:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:37:40.972579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-da725e6a-a9c0-4c01-8866-22f6c1ff87c8 req-9dd5c0e8-eeba-441b-9489-8bb823c5da56 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036347 May 31 22:37:40.973183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 149/305] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:40.988096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:40.993507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:40.996008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.996806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:40.997759 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:40.998201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.002602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:41.151903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:41.160350 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0862e581-37db-466e-afc4-6f63e83ac3fc tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.266689 May 31 22:37:41.161069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 157/306] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:40 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:41.482843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:41.510974 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c8dca74-8051-4701-9181-dab56f4b609e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.525407 May 31 22:37:41.510974 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 150/307] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:40 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:41.709751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:41.710391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:41.718411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.718871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.719706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.720323 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.856728 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:41.867129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:41.868659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:41.869854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-90460877-7e51-4d38-b9ec-0ff16cf0185b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.164255 May 31 22:37:41.870490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 158/308] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:41 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:41.911031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:41.911834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:41.918920 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.919446 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.920286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.920802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.939177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:41.939785 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:41.947073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.947520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:41.948287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:41.948719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.064464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:42.074305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-09f4a95a-8786-4c0a-9c06-7cd601d07bb0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.167112 May 31 22:37:42.074961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 151/309] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:41 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:42.084269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:42.092805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-42e1c2e9-0b76-45dc-bb78-1a602732cb33 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.157445 May 31 22:37:42.093363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 159/310] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:41 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:42.176988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:42.177592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:42.183869 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.184315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.185072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.185511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.314864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:42.322301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3d637107-9b3f-419b-bc16-278221251b9c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.149177 May 31 22:37:42.322882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 152/311] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:42 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:42.527931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:42.528543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:42.534457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.534948 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.535716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.536193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.669415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:42.676851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cbc631b5-5f34-4c30-8cd2-ec17501d52fc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.152783 May 31 22:37:42.677418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 160/312] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:42 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:42.889072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:42.889583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:42.891454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:42.896291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.896733 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:42.897482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:42.897933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.034291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.042989 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.044641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.045877 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ab428b6d-a03d-4873-9023-5ba1f77d5126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.160737 May 31 22:37:43.046503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 153/313] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:42 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:43.079706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-aaaf03b9-b01b-49ce-a550-ecc71443249b req-15b90442-df04-4292-a6db-60abb3a18667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "name": "network-vif-plugged", "status": "completed", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:43.088698 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-aaaf03b9-b01b-49ce-a550-ecc71443249b req-15b90442-df04-4292-a6db-60abb3a18667 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.089152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-aaaf03b9-b01b-49ce-a550-ecc71443249b req-15b90442-df04-4292-a6db-60abb3a18667 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.095784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:43.099212 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:43.101974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-aaaf03b9-b01b-49ce-a550-ecc71443249b req-15b90442-df04-4292-a6db-60abb3a18667 service nova] Creating event network-vif-plugged:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:37:43.102677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.103163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.103932 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.104367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.107776 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-aaaf03b9-b01b-49ce-a550-ecc71443249b req-15b90442-df04-4292-a6db-60abb3a18667 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031766 May 31 22:37:43.108544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 161/314] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:43.113665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:43.114400 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:43.121259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.121712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.122481 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.122965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.245953 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.253419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ef0cb33c-39f5-4245-95da-8c3333231ca5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.165549 May 31 22:37:43.253971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 154/315] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:43 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:43.270031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.278178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-421c5d41-99b3-4191-a9eb-2810e2ec4219 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.168579 May 31 22:37:43.278765 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 162/316] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:43 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:43.338868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:43.341142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:43.345413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.345850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.346599 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.347055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.489328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.497407 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ec7293fd-cb48-4887-b3ad-e3a9bc39ca78 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.162586 May 31 22:37:43.501657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 155/317] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:43 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:43.693513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:43.694045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:43.700075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.700531 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.701304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:43.701745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:43.834942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:43.842739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e215df62-b03e-4abb-8c8a-6efd627cadc6 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.153188 May 31 22:37:43.843328 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 163/318] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:43 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:44.065409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:44.066019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:44.074112 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.074718 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.075651 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.076252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.207585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.216252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.217824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.219010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eb898ad3-82df-4a14-bf94-7ea7f6698550 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.157990 May 31 22:37:44.223113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 156/319] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:44 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:44.270615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:44.271237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:44.278572 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.279047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.279800 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.280260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.282837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:44.295304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:44.296021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:44.301942 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.302387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.303186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.303619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.413920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.421457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87bd76d1-8b26-439c-8045-24d8632b9cf3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.154699 May 31 22:37:44.422030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 164/320] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:44 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:44.442750 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.452626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f4f4920-afde-45f1-94be-62334d4cf839 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.161050 May 31 22:37:44.453210 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 157/321] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:44 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:44.517380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:44.518440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:44.527623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.528070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.528983 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.529441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.662952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:44.670357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-473ab8d3-3ce8-4078-980b-a7a320460ed2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.157882 May 31 22:37:44.670931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 165/322] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:44 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:44.860355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:44.860964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:44.867743 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.868200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:44.868986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:44.869479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.000111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.007625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-599da721-c43f-463e-bee0-6f352d5157f2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.151085 May 31 22:37:45.008193 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 158/323] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:44 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:45.237578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:45.238187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:45.240585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:45.240765 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=22 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:45.245586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.246047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.246839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.247284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.380808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.392416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.393989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.395226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3ad1487d-1dff-4c97-bf45-9a7d855eb5e3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.161568 May 31 22:37:45.395782 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 166/324] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:45 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:45.439256 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:45.439930 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:45.442004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=10 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:45.447368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.447811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.448561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.448995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.470212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:45.470855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:45.477411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.477864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.478634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.479099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.594061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.600698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-edd0c1a2-ab63-4766-b2c6-7e7e71cb611b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.165270 May 31 22:37:45.601261 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 159/325] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:45 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:45.624722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.633250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-74df8385-9e4a-4b36-935d-ee5fd78ee9c1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.167094 May 31 22:37:45.633806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 167/326] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:45 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:45.687251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:45.687857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:45.693843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.694223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.695544 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:45.695987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:45.828930 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:45.837088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-74a32983-3de5-4004-b18c-e966ba32b0a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.153672 May 31 22:37:45.837660 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 160/327] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:45 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:46.024321 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:46.024932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:46.030989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.031442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.032206 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.032644 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.162639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.170108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fac921d1-819c-41cf-af3d-7e4c97000a61 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.149708 May 31 22:37:46.170674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 168/328] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:46 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:46.414578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:46.415243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:46.421303 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.421748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.422494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.422955 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.554740 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.563369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.564871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.566007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d856b27-124f-459d-bd37-0a49e92f93aa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.155890 May 31 22:37:46.566557 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 161/329] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:46 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:46.617337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:46.618377 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:46.625042 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.625575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.626606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.627215 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.651036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:46.651645 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:46.657701 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.658139 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.658934 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.659362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.774741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.786366 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f5624e1-a177-4a31-8191-558a0352dcb9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.172758 May 31 22:37:46.787632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 169/330] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:46 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:46.808538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:46.817218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-57ab75e4-78fc-423c-bbb1-250a9c419ed2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1721 microversion: 2.1 time: 0.170557 May 31 22:37:46.817815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 162/331] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:46 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:46.854216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:46.854855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:46.860974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.861427 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.862199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:46.862633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:46.999438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.007348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e7abe541-ea90-4981-b705-c413cf2e0d28 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.157266 May 31 22:37:47.007931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 170/332] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:46 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:47.187255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:47.187858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:47.195336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.195778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.196550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.196982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.336768 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.345029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e13e0894-7990-4ac2-9ba1-c32c5a89d9f5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.161628 May 31 22:37:47.348501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 163/333] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:47 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:47.583503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:47.584029 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:47.589993 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.590439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.591224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.591660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.729306 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.737406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.738994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.740158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8772828-0248-44eb-9503-c9177701149c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.160667 May 31 22:37:47.740807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 171/334] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:47 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:47.804361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:47.805056 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:47.812059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.812502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.813307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.813739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.835362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:47.835896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:47.841836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.842283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.843073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:47.843507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:47.946755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.954376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7202dd8b-61e6-4765-992f-ac1f63f905f6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.155110 May 31 22:37:47.954967 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 164/335] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:47 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:47.982740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:47.990745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b8aa231d-8860-44b1-8987-afd13a2bec3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1698 microversion: 2.1 time: 0.159250 May 31 22:37:47.991897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 172/336] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:47 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1698 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:48.007564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f3c72c5c-6f9d-4036-bfcc-10cb20738c5e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:48.013655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3c72c5c-6f9d-4036-bfcc-10cb20738c5e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.014100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3c72c5c-6f9d-4036-bfcc-10cb20738c5e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.025497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:48.026101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:48.032099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.032541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.033289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.033724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.076236 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f3c72c5c-6f9d-4036-bfcc-10cb20738c5e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Going to try to start instance {{(pid=124589) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 22:37:48.167602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.175059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-32120ebf-f927-419f-b4ca-12682c221bcb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.153425 May 31 22:37:48.175619 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 173/337] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:48 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:48.230033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:48.361943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:48.362547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:48.368596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.369040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.369798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.370230 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.382704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f3c72c5c-6f9d-4036-bfcc-10cb20738c5e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.378762 May 31 22:37:48.387882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 165/338] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:37:48 2022] POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 22:37:48.392030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:48.392723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:48.400142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.400606 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.401473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.401922 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.509852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.518007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7a0c7745-712b-4afa-b850-891a50febf44 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.159943 May 31 22:37:48.518872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 174/339] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:48 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:48.544090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.552339 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-02a74db4-5d1f-40d3-bfb9-63c28b8f2270 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1707 microversion: 2.1 time: 0.164491 May 31 22:37:48.552905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 166/340] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:48 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:48.759233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:48.759869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:48.766233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.766673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.767493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.767926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.904471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.916512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.916512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:48.916512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87c69016-daeb-4293-ac7b-1686bb962a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.161632 May 31 22:37:48.916968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 175/341] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:48 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:48.974148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:48.974764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:48.977354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:48.982474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.982847 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:48.983715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:48.984157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.180151 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:49.192108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:49.192712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:49.195707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-abb2c095-a721-4940-a3a6-65344b1105f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.227534 May 31 22:37:49.196390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 167/342] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:48 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:49.200381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.200847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.201641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.202084 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.331857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:49.339411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-041a96a6-e37f-4a7c-9986-42db7cf23566 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.151163 May 31 22:37:49.340005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 176/343] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:49 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:49.535071 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:49.535626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:49.542110 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.542557 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.543354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.543786 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.569112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:49.569817 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:49.571654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:49.576304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.576746 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.577503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.577934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.682842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:49.691168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-85326421-f2c6-40d7-b90f-fdabc4a5da07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.159912 May 31 22:37:49.692226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 168/344] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:49 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:49.723213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:49.732273 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-379be5f2-d1bb-4ee7-9fb4-710d4b0d7355 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1707 microversion: 2.1 time: 0.166903 May 31 22:37:49.732846 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 177/345] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:49 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1707 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:49.934907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:49.935514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:49.941426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.941875 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:49.942630 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:49.943099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.074863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.082906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.084425 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.086246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cad07009-6f38-4712-a572-d9c5b9ea7fb5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.155250 May 31 22:37:50.093327 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 169/346] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:49 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:50.212656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:50.213298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:50.219355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.219798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.220553 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.220979 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.349382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.356043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:50.356751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:50.356983 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-10a65820-c88e-41fa-9010-4169d3a454d1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.148816 May 31 22:37:50.357558 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 178/347] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:50 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:50.362896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.363342 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.364109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.364545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.497501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.505211 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0416d428-558b-47bf-84a4-15b3834fd11f tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.153183 May 31 22:37:50.505791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 170/348] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:50 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:50.707719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:50.708335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:50.714708 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.714915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.715677 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.716120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.749976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:50.750572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:50.756529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.756973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.759775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:50.759775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:50.874749 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.880875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ee92d85b-a916-4c46-838a-2dd3a8969678 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.176854 May 31 22:37:50.881977 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 179/349] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:50 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:50.919313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:50.927195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2cd7f028-135f-46fb-8e40-e2f276dc2d99 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1711 microversion: 2.1 time: 0.181617 May 31 22:37:50.927998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 171/350] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:50 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1711 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:51.107016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:51.107667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:51.115082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.115528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.116399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.117282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.298439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:51.300799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:51.308264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:51.309814 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:51.310987 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d39db487-0d7a-4636-8f44-efab317a4c3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.209053 May 31 22:37:51.311532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 180/351] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:51 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:51.373260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:51.373805 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:51.380276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.380717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.381463 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.382559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.507629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:51.514977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-da84e119-daad-4468-ac9a-f201ef19256d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.145481 May 31 22:37:51.515538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 172/352] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:51 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:51.521995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:51.522602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:51.529165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.529610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.530369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.530819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.656058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:51.664204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2a6fa607-6dee-4742-93a3-8ae1287aeab1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.146550 May 31 22:37:51.664764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 181/353] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:51 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:51.898056 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:51.899046 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:51.910871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.911254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:51.912034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:51.912474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.076171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.083892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e8bbcd43-b7d1-433f-9e81-ff20aee6a4f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.190253 May 31 22:37:52.084764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 173/354] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:51 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:52.329443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:52.330041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:52.337203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.337648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.338406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.338866 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.478975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.487134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.488608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.489804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-89751ea4-e913-4ec4-bf63-7f648834f3a7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.164263 May 31 22:37:52.490363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 182/355] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:52 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:52.532241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:52.533440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:52.541232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.541891 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.542676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.543150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.682309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:52.683214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:52.689381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.689546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.689984 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.690751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:52.691205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:52.699713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f589f1b4-3290-4da3-b906-ca24a1e883ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.171400 May 31 22:37:52.700940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 174/356] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:52 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:52.836897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:52.844896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2ceb3e17-e2d2-45c4-a6d1-e4c4903b94e1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.167295 May 31 22:37:52.845512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 183/357] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:52 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:53.113014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:53.113639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:53.126572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.127234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.128031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.128478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.302808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:53.311714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-22511ede-e848-4969-8aec-c7fa700d308e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.214110 May 31 22:37:53.312629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 175/358] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:53 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:53.507388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:53.507983 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:53.514710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.515187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.515978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.516419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.656831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:53.665578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:53.667134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:53.668290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a228288-6f68-488d-a39d-270cdd502d0b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.164803 May 31 22:37:53.678817 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 184/359] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:53 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:53.717024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:53.717798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:53.724656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.725053 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.725908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.726274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.861657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:53.862257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:53.872063 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.872286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:53.872649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.874812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:53.874812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:53.884375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b9110c3-40e0-4385-a8c9-c38f5dcc06b2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.169714 May 31 22:37:53.885980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 176/360] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:53 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:54.020945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:54.029671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-60b2a1a8-f01d-4bc3-a757-de9bb3cf99d2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.171906 May 31 22:37:54.038647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 185/361] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:53 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:54.327996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:54.328602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:54.334869 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.335545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:54.336314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.336746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:54.482376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:54.489998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f79687d1-ed7c-4ad0-8e29-d6e21fa3298e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.166011 May 31 22:37:54.490559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 177/362] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:54 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:54.687396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:54.688053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:54.695179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.695635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:54.696416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.696855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:54.872401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:54.880554 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:54.882083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:54.883275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-934546ee-143d-459f-bc82-fdd804421b36 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.200435 May 31 22:37:54.883836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 186/363] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:54 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:54.902202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:54.903040 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:54.909769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.910222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:54.911043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:54.911481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.046091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:55.047058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:55.059175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.059619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:55.059749 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.060632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.061146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.071172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b874519d-a9ba-4c00-9f84-4742fbd94953 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.173787 May 31 22:37:55.072160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 178/364] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:54 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:55.227248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:55.237697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bfb58a8c-51a7-491b-8a3c-0122a84e9d52 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.195509 May 31 22:37:55.247037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 187/365] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:55 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:55.268765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-0322ad26-24a4-4605-91c8-277d80f363d4 req-57928ccc-a0f7-4136-ad31-06ba6cfd14ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20693ef7-74d7-4abb-8e36-5390380de3c8", "name": "network-vif-plugged", "status": "completed", "tag": "3e1b5caa-a076-4fff-93dc-cba5f814d2bc"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:37:55.278547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0322ad26-24a4-4605-91c8-277d80f363d4 req-57928ccc-a0f7-4136-ad31-06ba6cfd14ba service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.279112 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0322ad26-24a4-4605-91c8-277d80f363d4 req-57928ccc-a0f7-4136-ad31-06ba6cfd14ba service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.293927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-0322ad26-24a4-4605-91c8-277d80f363d4 req-57928ccc-a0f7-4136-ad31-06ba6cfd14ba service nova] Creating event network-vif-plugged:3e1b5caa-a076-4fff-93dc-cba5f814d2bc for instance 20693ef7-74d7-4abb-8e36-5390380de3c8 on hv-cinder-84414 May 31 22:37:55.299661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-0322ad26-24a4-4605-91c8-277d80f363d4 req-57928ccc-a0f7-4136-ad31-06ba6cfd14ba service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034563 May 31 22:37:55.300355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 179/366] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:37:55.506733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:55.507296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:55.513541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.513990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.514759 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.515216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.648410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:55.656052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c06046e-94c7-48e8-8dc5-82777e1c9c07 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.153278 May 31 22:37:55.656617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 188/367] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:55 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:55.902520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:55.903336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:55.910295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.910741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:55.911536 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:55.911970 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.051268 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.061496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.063323 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.064476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39270575-ae4b-4267-9411-abc419f82ce0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.167404 May 31 22:37:56.065021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 180/368] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:55 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:56.088659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:56.089470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:56.095748 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.096190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.096960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.097389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.237296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.251275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d536eb47-7d12-440e-80ad-e1d55e04ec95 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.166915 May 31 22:37:56.251862 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 189/369] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:56 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:56.253972 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:56.254576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:56.263904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.264345 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.265122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.265548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.420938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.428974 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d941000-abae-475b-a194-aaa35e797a0d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.178900 May 31 22:37:56.430329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 181/370] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:56 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:56.673523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:56.674050 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:56.681476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.681922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.682692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:56.683149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:56.820962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:56.828507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-44924eac-bd82-4762-b29f-7717dedb5dd5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.158906 May 31 22:37:56.829116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 190/371] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:56 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:57.082851 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:57.083526 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:57.090983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.091756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.092571 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.093044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.235898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:57.244698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:57.246307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:57.247465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-61bd7c8a-c047-4fb8-855d-221febaba2fa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.168762 May 31 22:37:57.248218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 182/372] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:57 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:57.268898 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:57.269499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:57.277930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.278488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.279631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.281700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.422125 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:57.432415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dfdeab09-0fc5-4ee3-9703-801b3ee134e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.167052 May 31 22:37:57.432999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 191/373] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:57 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:57.446684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:57.447275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:57.468179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.468804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.469586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.470025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.474280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:37:57.605499 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:57.613481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-16c8b373-3e93-4ff3-808c-1113325b9fe1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.171618 May 31 22:37:57.614144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 183/374] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:57 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:57.845082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:57.846163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:57.853973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.854831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.856115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:57.856705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:57.996589 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.004192 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-46745b1a-5df1-4ca4-8472-9eb2707934b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.163018 May 31 22:37:58.004759 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 192/375] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:57 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:58.265538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:58.266951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:58.274252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.274696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.275741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.276169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.420360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.429502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.431618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.432802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04207c76-7916-4a73-a090-ff7d389ffbb2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.171058 May 31 22:37:58.437243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 184/376] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:58 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:58.449603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:58.450219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:58.456642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.457125 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.458157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.459137 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.618504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.625827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7c719d40-e54d-4ef7-89ac-ead616a5ce60 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.180295 May 31 22:37:58.630762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:58.631426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:58.638295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.638742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.639255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 193/377] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:58 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:58.640132 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:58.640879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:58.776739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:58.784769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-aae0a4fd-6560-491f-9f44-ac0514f921f2 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.157736 May 31 22:37:58.785376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 185/378] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:58 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:37:59.021558 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:59.022911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:59.029060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.029438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.030209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.030642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.166456 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.174659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-da1723cb-ebab-4cad-99cb-e81427d29b7b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.157044 May 31 22:37:59.175261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 194/379] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:59 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:59.455077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:59.455732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:59.462313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.462752 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.463552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.463988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.623803 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.632421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.636558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.636558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5e92fe91-7276-4526-971b-923be9e11b54 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.183935 May 31 22:37:59.636558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 186/380] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:37:59 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:37:59.656496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:59.659732 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:59.665356 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.665800 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.666630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.667095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.802381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:37:59.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:37:59.811883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.814361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.814361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.814361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:37:59.814657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:37:59.821578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ab03284c-5793-4ddf-8170-b6a02b8fea6a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.168987 May 31 22:37:59.822303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 195/381] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:59 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:37:59.969034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:37:59.977354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fd6d627f-cf10-4361-a6c1-ebf7cb94d9b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.179740 May 31 22:37:59.977917 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 187/382] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:37:59 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:00.192045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:00.192582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:00.199371 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.199824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.200604 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.201045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.331778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:00.344491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-35223626-4b81-4306-a324-585626ce501b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.156501 May 31 22:38:00.345286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 196/383] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:00 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:00.387741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1887257939", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-706992965", "security_groups": [{"name": "tempest-secgroup-smoke-213198774"}], "networks": [{"uuid": "0b71262e-42b4-4bf1-b69f-18737e00c830"}], "block_device_mapping_v2": [{"uuid": "c5e9ac29-f924-4d65-af1d-efaf33f03601", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:00.512207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] validate_networks() for [('0b71262e-42b4-4bf1-b69f-18737e00c830', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:38:00.654492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:00.655143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:00.662145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.663864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.664881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.665478 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.682193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:00.812481 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:00.820954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:00.822510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:00.823704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b80bacd7-4104-4de1-b1c2-d5753d14262c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.174138 May 31 22:38:00.832945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 197/384] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:00 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:00.838422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:00.842880 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:00.849251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.851034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.851204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.851576 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.957321 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:38:00.957751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:38:00.958235 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:38:00.958720 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:38:00.959173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:38:00.969731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.970182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.971179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:00.979976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:00.990195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Getting quotas for project 4d6702a00ff84f5b89028341f38f5e45. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:38:00.995391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Getting quotas for user 9c53e726c0e241e48a9ae68ba802abfc and project 4d6702a00ff84f5b89028341f38f5e45. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:38:01.008869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:01.016898 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80e1b5d2-dda7-436a-b206-f664422e9854 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.182633 May 31 22:38:01.027796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 198/385] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:00 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:01.032935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:01.033561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:01.040725 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.041407 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.042365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.043024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.068248 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:38:01.070683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c5e9ac29-f924-4d65-af1d-efaf33f03601',volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:38:01.196195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:01.204634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-217d4f5f-cc36-49c7-92c0-dd0236dfc30b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.175516 May 31 22:38:01.208608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 199/386] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:01 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:01.361500 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:01.362378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:01.368700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.369151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.370090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.370534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.516019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:01.526110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5f8d085b-40ba-4a1b-a0d9-6df22e3545fe tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.168464 May 31 22:38:01.526968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 200/387] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:01 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:01.546235 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce43133a-b757-48d3-90e3-953c3a14bc07 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.162422 May 31 22:38:01.546903 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 188/388] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:38:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1164 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:38:01.558383 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c0f9225-d52c-4c1c-91e3-44fc54d9d855 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:01.559682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c0f9225-d52c-4c1c-91e3-44fc54d9d855 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:01.560307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0fde505f-6b73-4c24-8d15-fcfad033b9d2", "device": "/dev/sdb"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:01.562129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:01.571357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.575159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.575159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.575159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.642633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c0f9225-d52c-4c1c-91e3-44fc54d9d855 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:01.651165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c0f9225-d52c-4c1c-91e3-44fc54d9d855 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1088 microversion: 2.1 time: 0.097874 May 31 22:38:01.653567 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 189/389] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:01 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1088 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:01.851057 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:01.851667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:01.858550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.861291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.861291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:01.861291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:01.994586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.003037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.004547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.006991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a4109c44-70ca-4717-b599-d633d6dc82c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.159160 May 31 22:38:02.007561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 190/390] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:01 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:02.034592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:02.037061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:02.042622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.043126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.043928 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.044362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.172333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.181648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f1bdc70c-75a0-40f7-b30b-a7dbab331c4f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.150840 May 31 22:38:02.182224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 191/391] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:02 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:02.223343 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:02.223951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:02.230375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.230850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.231619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.232055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.374671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.380684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e733233a-16af-40f4-ac4a-23836ffab17b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.161205 May 31 22:38:02.381302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 192/392] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:02 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:02.544090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:02.544706 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:02.551138 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.551718 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.552344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.552797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.681854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.689253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-172b3289-868d-4682-8a1e-6b311b491d05 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.149016 May 31 22:38:02.689810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 193/393] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:02 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:02.694627 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:02.695275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:02.700863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.701294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.702054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:02.702491 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:02.768836 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:02.777070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d0261065-e670-4d7b-90e0-ec159fc5d612 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1138 microversion: 2.1 time: 0.086307 May 31 22:38:02.777634 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 194/394] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:02 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:03.021575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-adcf6a51-115d-4ddb-9c37-72bd9b0d7538 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "POST /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.470100 May 31 22:38:03.022903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 201/395] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:38:01 2022] POST /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:03.026238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:03.026894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:03.033046 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.033492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.034438 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.034904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.165063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.173105 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.174736 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.175975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0a7b513a-087e-41d5-b31b-9c53c8baa553 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.154451 May 31 22:38:03.176549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 195/396] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:03 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:03.200715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:03.201453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:03.207820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.208259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.209023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.209463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.345780 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.353226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c4d254fc-86cb-44fb-8aa3-e05af61fce1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.156757 May 31 22:38:03.353793 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 202/397] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:03 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:03.397336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:03.397946 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:03.404100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.404547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.405365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.405799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.531834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.539717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89012d7d-bfe4-4ebd-a11a-f74c077d071e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.146211 May 31 22:38:03.544172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 196/398] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:03 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:03.705801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:03.709011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:03.713693 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.714182 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.715061 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.716499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.794496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:03.794883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:03.801563 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.802011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.802849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:03.803300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:03.875950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.885862 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7e66d0fb-32ef-4269-b9b1-5cd67469625c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.184214 May 31 22:38:03.887461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 203/399] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:03 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:03.906717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:03.915717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ee7c82bf-94f4-4b54-8d14-d130477e6d87 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1138 microversion: 2.1 time: 0.125467 May 31 22:38:03.916631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 197/400] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:03 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1138 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:04.197209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:04.218380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:04.218380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.218380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.218380 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.218813 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.370127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:04.414363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:04.414363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.414363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.414363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.415021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.415127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:04.415127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:04.416188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:04.418314 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06e4c20d-c26b-4a3b-8431-f6108db585e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.225344 May 31 22:38:04.429539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 204/401] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:04 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:04.547300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:04.557395 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:04.566861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:04.570257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-336fbfb0-eb2c-4e73-bf32-1c38e9441979 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.201253 May 31 22:38:04.571071 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 198/402] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:04 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:04.574769 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.575249 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.576041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.576480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.899701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:04.907034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:04.908993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:04.911230 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-787ac221-39b6-4003-b128-b88dc177e04d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.358178 May 31 22:38:04.912613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 205/403] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:04 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:04.917320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.917878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.919092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.919639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.934675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:04.935567 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:04.942460 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.943165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:04.944793 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:04.945384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.020765 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.031606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2e827dd5-275b-43cf-bae9-9b8a8e163df3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1138 microversion: 2.1 time: 0.101431 May 31 22:38:05.040909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 206/404] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:04 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1138 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:05.118003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.125767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3e14cebb-72a7-4f0d-8450-c41200dc4256 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.225879 May 31 22:38:05.135408 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 199/405] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:04 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:05.440717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:05.441320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:05.448574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.449244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.450033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.450479 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.590154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:05.590963 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:05.598041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.601174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.602246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.602950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.604418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.614299 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.616385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.617559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e6b61956-bebc-4afd-b549-352e6d484242 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.184649 May 31 22:38:05.618145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 207/406] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:05 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:05.787314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:05.796025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-58de3596-b526-4747-bafe-2047079c0561 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.209991 May 31 22:38:05.796797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 200/407] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:05 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:05.939978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:05.940867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:05.947590 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.948276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:05.950252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:05.951249 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.047871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:06.049325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:06.064353 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.064812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.065596 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.066025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.088988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:06.097642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.108584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7a2757a-c1ce-4f39-b11a-0ef34bca8a86 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.182525 May 31 22:38:06.108584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 208/408] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:05 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:06.137194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.143544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:06.144297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:06.147698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b689ba0d-a173-433f-9be6-7b0b8bd922ed tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1138 microversion: 2.1 time: 0.103074 May 31 22:38:06.148645 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 201/409] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:06 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1138 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:06.151536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.152234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.153016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.153458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.308258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.315926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-77376526-8a25-499b-8128-fcfa5e2927a5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.176739 May 31 22:38:06.317010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 209/410] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:06 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:06.636644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:06.637199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:06.643653 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.644167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.645014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.645453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.780796 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.788829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.790322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.791487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9e9fd4d1-0951-44ad-8201-5fed1c77a3e6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.159061 May 31 22:38:06.792035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 202/411] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:06 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:06.813396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:06.814006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:06.824152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.824600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.825359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:06.825797 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:06.956916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:06.964583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d48c92a-c6b5-45d4-bad8-65be36c29ddc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.154986 May 31 22:38:06.965353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 210/412] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:06 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:07.125449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:07.126058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:07.135874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.136356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.137137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.137575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.164791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:07.165303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:07.172083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.172845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.173677 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.174177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.258010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:07.267258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cd46aa03-ca6a-4249-bb9c-ee1e4cfa5952 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1138 microversion: 2.1 time: 0.106333 May 31 22:38:07.273637 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 211/413] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:07 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1138 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:07.327918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:07.338144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e10776bb-063e-495e-a1ca-f7538ade6f83 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.216650 May 31 22:38:07.341721 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 203/414] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:07 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:07.344281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:07.345390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:07.358727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.360815 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.361840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.363012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.595920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:07.598349 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:07.608344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b2d95a17-efea-42ad-a0c6-f48702b15f3f tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.279116 May 31 22:38:07.609337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 212/415] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:07 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:07.810546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:07.811286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:07.818609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.819546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.820668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:07.821266 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:07.982195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:07.982841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:08.002151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.002910 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.003831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.004224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.031812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.043375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.045981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.047747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-84596f75-16f4-4dbf-80fc-4b717d05abdb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.241833 May 31 22:38:08.048311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 204/416] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:07 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:08.165149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.174035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9497eda0-4c78-4e68-a1f5-0e8c85cf751a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.196089 May 31 22:38:08.181649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 213/417] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:07 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:08.285198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:08.285728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:08.293793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.294518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.295539 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.296133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.355724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:08.356738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:08.365383 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.366474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.367383 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.367673 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.368317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.375347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff1b3b15-39f9-4d75-86cd-2c256e2fc85e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1186 microversion: 2.1 time: 0.094544 May 31 22:38:08.376437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 205/418] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:08 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:08.512701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.520750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0f64f0c8-49fe-411b-8ff7-897f81b503e7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.168818 May 31 22:38:08.521552 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 214/419] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:08 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:08.625081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:08.625693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:08.631964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.632421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.633910 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:08.634523 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:08.779124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:08.789137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-781ee869-883b-4f26-a417-3fab1dbc9146 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.167782 May 31 22:38:08.796440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 206/420] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:08 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:09.066239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:09.067465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:09.074664 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.075331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.076959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.077561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.208041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:09.212234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:09.222489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.223425 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.224484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.228652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.250122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.264032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.265944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.267437 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-459e9da8-ea64-431b-ade1-dd8ca817b75e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.205809 May 31 22:38:09.287357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 215/421] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:09 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:09.394959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:09.395577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:09.421183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.421639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.428737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.431012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.476321 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.489133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4e5c0248-de93-4208-b219-37ba2fd49e02 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1366 microversion: 2.1 time: 0.290077 May 31 22:38:09.489975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 207/422] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:09 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:09.498562 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-5cc0282c-5278-4c9e-932d-91ab06d48e58 req-c6b7508d-d349-49dd-a0dc-ecab71311f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "name": "network-vif-plugged", "status": "completed", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:09.505746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:09.508104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-5cc0282c-5278-4c9e-932d-91ab06d48e58 req-c6b7508d-d349-49dd-a0dc-ecab71311f29 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.516194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-5cc0282c-5278-4c9e-932d-91ab06d48e58 req-c6b7508d-d349-49dd-a0dc-ecab71311f29 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.521344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-5cc0282c-5278-4c9e-932d-91ab06d48e58 req-c6b7508d-d349-49dd-a0dc-ecab71311f29 service nova] Creating event network-vif-plugged:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:38:09.527873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-5cc0282c-5278-4c9e-932d-91ab06d48e58 req-c6b7508d-d349-49dd-a0dc-ecab71311f29 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035451 May 31 22:38:09.528591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 208/423] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:09.543633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:09.544686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:09.553870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.553870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.554201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.554764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.563424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.572574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-637f1f5f-bd5e-426b-babb-2b3f325cd4ff tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1186 microversion: 2.1 time: 0.183012 May 31 22:38:09.573378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 216/424] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:09 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1186 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:09.752208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:09.760599 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-632f9c36-cc85-4c73-b1b2-f93be376312e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.221580 May 31 22:38:09.761292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 209/425] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:09 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:09.807648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:09.808373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:09.818636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.819288 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.820235 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:09.821043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:09.992943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.000560 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e4b7fc1d-50ba-4fb0-aa69-72cff2deaeb9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.197922 May 31 22:38:10.001591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 217/426] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:09 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:10.292179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:10.293254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:10.308688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.309520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.311036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.311626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.515950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:10.515950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:10.520828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.521367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.522199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.522774 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.542931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.558307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.560133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.561528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-79352be3-9835-4988-b526-0130a6805fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.275070 May 31 22:38:10.572580 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 210/427] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:10 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:10.590665 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:10.591331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:10.608315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.608776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.609577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.610007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.677337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.681023 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:10.686714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a566b822-5a5a-4f10-b9ea-9c017987f67a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1557 microversion: 2.1 time: 0.182761 May 31 22:38:10.687322 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 218/428] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:10 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1557 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:10.688673 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d595f3a2-775d-4218-9a3a-100feb0587c7 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1194 microversion: 2.1 time: 0.102857 May 31 22:38:10.689227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 211/429] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:10 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1194 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:10.705292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:10.705785 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:10.712438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.712917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.713680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.714112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.778040 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:10.779003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:10.784727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.785171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.785926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:10.786360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:10.837102 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eadeccaf-0406-4267-9921-2cd9b1ad7b05 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.135689 May 31 22:38:10.844787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 219/430] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:38:10 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/os-interface => generated 285 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:38:10.981658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:11.019046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:11.019664 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:11.033205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.033656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.034435 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.034909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.149003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:11.158239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5785a9ba-eb85-4c32-9693-b5e54ca79fe5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.383908 May 31 22:38:11.158844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 212/431] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:10 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:11.317824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:11.329278 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-108a0a85-bc53-4675-bbf8-7a29144a76b0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.314043 May 31 22:38:11.331423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 220/432] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:11 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:11.580302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:11.581016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:11.595803 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.596727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.598944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.600889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.651775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=8 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:11.722050 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:11.723739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:11.734680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.735736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.742535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:11.742535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:11.923523 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:11.936242 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:11.938617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:11.940797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7de46ad6-51a0-43c8-9407-01799ee6573a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.365493 May 31 22:38:11.961376 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 213/433] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:11 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:12.169244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f39e0b8a-5fa2-4323-a004-19f2352d0229 req-03c5cb37-1352-45c2-8e81-c8fd85239790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "name": "network-vif-plugged", "status": "completed", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:12.190052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f39e0b8a-5fa2-4323-a004-19f2352d0229 req-03c5cb37-1352-45c2-8e81-c8fd85239790 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.190771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f39e0b8a-5fa2-4323-a004-19f2352d0229 req-03c5cb37-1352-45c2-8e81-c8fd85239790 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.221280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f39e0b8a-5fa2-4323-a004-19f2352d0229 req-03c5cb37-1352-45c2-8e81-c8fd85239790 service nova] Creating event network-vif-plugged:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:38:12.232359 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f39e0b8a-5fa2-4323-a004-19f2352d0229 req-03c5cb37-1352-45c2-8e81-c8fd85239790 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067178 May 31 22:38:12.233142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 214/434] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:38:12.247815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:12.249506 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:12.259126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.259818 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.263914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.263914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.813148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:12.814146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:12.833394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6fd0dd7c-e5c1-4492-92bf-200acf2256e5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 1.127445 May 31 22:38:12.833394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 221/435] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:11 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:12.844166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b44639c2-e0c0-41ff-a4d5-377cb1a600a3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1357 microversion: 2.1 time: 0.604046 May 31 22:38:12.844433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 215/436] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:12 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1357 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:12.849025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:12.849775 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:12.875246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.875703 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.877017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.877462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.964189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:12.964189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:12.974485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.976099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:12.984950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:12.984950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.177492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:13.188319 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:13.194889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:13.196200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e3f398b3-d244-4852-b166-ccd05dca1930 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.240361 May 31 22:38:13.197359 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 216/437] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:13.352907 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:13.375188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a44a789b-1037-43d3-8137-f6857e6387f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.529896 May 31 22:38:13.377433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 222/438] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:12 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:13.532212 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-75c0922b-3483-4a1e-a157-a72c371be948 req-51142559-1680-479f-a90b-926b91df1129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20693ef7-74d7-4abb-8e36-5390380de3c8", "tag": "3e1b5caa-a076-4fff-93dc-cba5f814d2bc"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:13.546353 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-75c0922b-3483-4a1e-a157-a72c371be948 req-51142559-1680-479f-a90b-926b91df1129 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.547365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-75c0922b-3483-4a1e-a157-a72c371be948 req-51142559-1680-479f-a90b-926b91df1129 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.587012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-75c0922b-3483-4a1e-a157-a72c371be948 req-51142559-1680-479f-a90b-926b91df1129 service nova] Creating event network-changed:3e1b5caa-a076-4fff-93dc-cba5f814d2bc for instance 20693ef7-74d7-4abb-8e36-5390380de3c8 on hv-cinder-84414 May 31 22:38:13.616351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-75c0922b-3483-4a1e-a157-a72c371be948 req-51142559-1680-479f-a90b-926b91df1129 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087889 May 31 22:38:13.617126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 217/439] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:13.640375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-b3ac4c0b-dd35-4ecc-9777-4f5dbc1f614e req-eee53173-1ab8-4883-b6e0-8c1fdb8944e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:13.653014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b3ac4c0b-dd35-4ecc-9777-4f5dbc1f614e req-eee53173-1ab8-4883-b6e0-8c1fdb8944e3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.656786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-b3ac4c0b-dd35-4ecc-9777-4f5dbc1f614e req-eee53173-1ab8-4883-b6e0-8c1fdb8944e3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.683222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-b3ac4c0b-dd35-4ecc-9777-4f5dbc1f614e req-eee53173-1ab8-4883-b6e0-8c1fdb8944e3 service nova] Creating event network-changed:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:38:13.701342 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-b3ac4c0b-dd35-4ecc-9777-4f5dbc1f614e req-eee53173-1ab8-4883-b6e0-8c1fdb8944e3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065107 May 31 22:38:13.709704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 223/440] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:13.849224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:13.855187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:13.860536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:13.861863 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:13.869534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.873201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.874293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.874965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.877638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.882282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:13.882282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:13.882282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.091960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.102489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af137433-9324-4ad6-ab43-0699397d8218 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.257342 May 31 22:38:14.103872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 218/441] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:13 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:14.153156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.162752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cfc55b50-8e3d-4a20-83d8-56e521f669d5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1546 microversion: 2.1 time: 0.305408 May 31 22:38:14.175591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 224/442] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:13 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1546 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:14.181088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:14.181707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:14.188417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.193488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.193488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.193488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.217042 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:14.217668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:14.226997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.227456 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.228250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.228696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.358669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.374166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-34553fa6-5946-48fe-bd42-8b3bdd8bb610 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1546 microversion: 2.1 time: 0.197207 May 31 22:38:14.375497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 219/443] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:14 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1546 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:14.394391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:14.399050 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.400100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Searching by: {'deleted': False, 'project_id': '411823fbbfc24cbf94dc4aff1129889f'} {{(pid=124589) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 31 22:38:14.408293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.409019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.410015 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.410657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.436280 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.445816 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.447773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.449128 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d984025c-5566-44b4-ae53-02f22546952a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.236513 May 31 22:38:14.466005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 225/444] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:14 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:14.476140 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:14.477264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:14.485610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.486331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.487316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.487917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.556602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:14.559249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.multi_cell_list [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124589) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 31 22:38:14.646944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.656007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8833904e-01f5-4294-a5ea-1890b646d0f1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.188542 May 31 22:38:14.657135 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 226/445] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:14 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:14.683503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80e89e78-5844-43df-8fcc-1868d952ae12 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.294115 May 31 22:38:14.689283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 220/446] 10.222.0.39 () {58 vars in 1124 bytes} [Tue May 31 22:38:14 2022] GET /compute/v2.1/servers => generated 342 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:14.695735 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:14.696546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:14.698741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:14.704453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.705088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.706148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:14.706747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:14.891701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:14.903662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f923c1d3-6a30-45c4-8710-86a2579a2e33 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1546 microversion: 2.1 time: 0.212842 May 31 22:38:14.904248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 227/447] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:14 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1546 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:15.120840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:15.121474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:15.141122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.141750 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.142754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.145271 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.337228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:15.344671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e3a2be50-6529-4dfc-8815-07c2ceb72b52 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.228427 May 31 22:38:15.345230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 221/448] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:15 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:15.467735 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:15.468340 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:15.474359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.474831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.475591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.476030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.611164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:15.616799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:15.618300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:15.619466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-37b8dd9c-1311-4cb7-b5b6-c4d4587c9da6 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.155701 May 31 22:38:15.620027 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 228/449] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:15 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:15.673629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:15.674333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:15.681440 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.681895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.682682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:15.683188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:15.849395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:15.858728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-38bf2443-8956-4ab4-b078-191eddfb0ba2 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.189095 May 31 22:38:15.869763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 222/450] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:15 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:16.362671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:16.363339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:16.370630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.371111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.371886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.372325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.505722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:16.513046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f98a23f9-d26c-4274-842a-d599cab843d6 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.155074 May 31 22:38:16.513609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 229/451] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:16 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:16.637445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:16.638154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:16.644710 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.645152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.645921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.646355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.801916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:16.810134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:16.811690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:16.812834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8677ef82-31b6-449a-acd1-192360f62c14 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.179311 May 31 22:38:16.813411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 223/452] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:16 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:16.877020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:16.877625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:16.887510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.888146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.888936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:16.889377 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:16.905039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:17.018185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:17.026169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7fe40a88-1a38-4c69-8e6b-5e7fd639e9b7 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.153481 May 31 22:38:17.026728 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 230/453] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:16 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:17.529898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:17.530499 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:17.536643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:17.537091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:17.537881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:17.538311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:17.666533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:17.673966 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f5cf6c7-7a38-4519-a8f0-ce68e97f67fe tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.147881 May 31 22:38:17.674523 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 224/454] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:17 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:17.831206 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:17.831737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:17.838304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:17.838758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:17.839565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:17.840037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:17.977500 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:17.986261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:17.987764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:17.989310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f40aeca8-0342-48ae-8dc4-ca2b18c7a233 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1739 microversion: 2.20 time: 0.161763 May 31 22:38:17.989477 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 231/455] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:17 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:18.043037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:18.043642 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:18.049950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.052540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.052540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.052540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.183458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:18.191042 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c184451-328c-4132-b1c5-2248b5dcf62c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.151923 May 31 22:38:18.192370 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 225/456] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:18 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:18.352329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f5c2d552-2f62-44e5-9b22-3e2b722cb43b"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:18.353837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:18.360662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.361106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.361876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.362311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.691452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:18.692003 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:18.698381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.698855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.699616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:18.700077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:18.829599 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:18.837792 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-256e915a-1404-451e-96ab-1c5c805ca551 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.150283 May 31 22:38:18.847066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 226/457] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:18 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:19.008371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:19.008968 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:19.014925 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.015367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:19.016157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.016589 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:19.232784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:19.242000 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:19.243960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:19.245355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d7312d48-1dc5-487f-8b7d-c04cb994e6ea tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1721 microversion: 2.20 time: 0.241561 May 31 22:38:19.257092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 227/458] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:19 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:19.264072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:19.264072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:19.270042 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.270726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:19.271756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.272351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:19.459234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:19.466919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80623550-1570-4746-8a75-820de3ba08e0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1372 microversion: 2.1 time: 0.208698 May 31 22:38:19.467666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 228/459] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:19 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1372 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:19.686162 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-001e4d5c-09a2-4b69-80e4-cc1d5c020587 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.339033 May 31 22:38:19.691232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 232/460] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:38:18 2022] POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments => generated 194 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:19.854369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:19.855005 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:19.861147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.861598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:19.862454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:19.862811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.023330 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:20.031044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f313e59f-6b45-454c-89e5-c62d763f71be tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.181115 May 31 22:38:20.031714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 229/461] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:19 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:20.273453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:20.274233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:20.281014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.281639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.282570 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.283201 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.419856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:20.428823 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:20.430623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:20.431793 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-614d3c77-39ca-48d2-95e7-e41dfa7a8978 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1721 microversion: 2.20 time: 0.163803 May 31 22:38:20.432347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 233/462] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:20 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:20.484285 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:20.485210 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:20.492254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.492701 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.493469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.493912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.622316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:20.629801 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e2c63069-b668-49be-a276-8c633f417eca tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1566 microversion: 2.1 time: 0.149413 May 31 22:38:20.630522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 230/463] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:20 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:20.646350 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:20.646870 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:20.652688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.653129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.653877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:20.654311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:20.730118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6f157558-dba0-4680-941b-7bc07ce38291 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087375 May 31 22:38:20.730713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 234/464] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:38:20 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:38:21.048079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:21.048797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:21.055873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:21.056399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:21.057150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:21.057591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:21.204796 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:21.212868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2d50aee7-f5ff-4e70-bc19-6c991ca06665 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.168795 May 31 22:38:21.213429 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 231/465] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:21 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:21.451466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:21.451982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:21.458296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:21.458734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:21.460115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:21.460547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:21.661657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:21.669680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:21.671251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:21.672424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d39f6267-ead0-4500-882f-9255b8061bd4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1721 microversion: 2.20 time: 0.225742 May 31 22:38:21.672977 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 235/466] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:21 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:21.805108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-aa97ad3d-e23e-4e46-81d5-a42771a83b81 req-305e70d0-18e7-44f6-9e9f-8ce5c4b51d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:21.814106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-aa97ad3d-e23e-4e46-81d5-a42771a83b81 req-305e70d0-18e7-44f6-9e9f-8ce5c4b51d87 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:21.814609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-aa97ad3d-e23e-4e46-81d5-a42771a83b81 req-305e70d0-18e7-44f6-9e9f-8ce5c4b51d87 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:21.826259 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-aa97ad3d-e23e-4e46-81d5-a42771a83b81 req-305e70d0-18e7-44f6-9e9f-8ce5c4b51d87 service nova] Creating event network-changed:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:38:21.831663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-aa97ad3d-e23e-4e46-81d5-a42771a83b81 req-305e70d0-18e7-44f6-9e9f-8ce5c4b51d87 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030526 May 31 22:38:21.832427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 232/467] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:22.231217 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:22.241931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:22.248917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:22.249111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:22.249949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:22.250675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:22.308126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-a9fb8c36-3116-4517-a398-b17c65ab7ac2 req-8e203514-2f87-4308-b69c-7ece4b243273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "name": "network-vif-unplugged", "status": "completed", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:22.318168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-a9fb8c36-3116-4517-a398-b17c65ab7ac2 req-8e203514-2f87-4308-b69c-7ece4b243273 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:22.318755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-a9fb8c36-3116-4517-a398-b17c65ab7ac2 req-8e203514-2f87-4308-b69c-7ece4b243273 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:22.330334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-a9fb8c36-3116-4517-a398-b17c65ab7ac2 req-8e203514-2f87-4308-b69c-7ece4b243273 service nova] Creating event network-vif-unplugged:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:38:22.335772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-a9fb8c36-3116-4517-a398-b17c65ab7ac2 req-8e203514-2f87-4308-b69c-7ece4b243273 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033485 May 31 22:38:22.336862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 233/468] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:22.395630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:22.404097 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5c00cec-248c-446f-814d-ec9f55eb99fa tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.177888 May 31 22:38:22.404676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 236/469] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:22 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:22.691368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:22.692081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:22.698398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:22.698863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:22.699641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:22.700074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:22.837454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:22.845511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:22.847398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:22.848411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b394d768-3cab-4c33-9f68-9f10b60ffd29 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1721 microversion: 2.20 time: 0.161397 May 31 22:38:22.848958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 234/470] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:22 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:23.421537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:23.422093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:23.429008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:23.429460 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:23.430480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:23.430952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:23.775475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:23.782839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-583a317e-b038-468f-a175-ad75007ade32 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.365311 May 31 22:38:23.783406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 237/471] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:23 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:23.867162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:23.867773 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:23.874097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:23.874543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:23.875336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:23.875781 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:24.010537 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:24.021636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:24.021636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:24.021865 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3951e5ea-459a-40ee-a935-1e260ddddc32 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1721 microversion: 2.20 time: 0.158334 May 31 22:38:24.022772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 235/472] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:23 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:24.798678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:24.799327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:24.806641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:24.807110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:24.807875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:24.808315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:24.936345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:24.944831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8f565547-0516-4668-b11e-ce2fbd275d3e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1271 microversion: 2.1 time: 0.149963 May 31 22:38:24.945650 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 238/473] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:24 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1271 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:25.040469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:25.041080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:25.043096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:25.048618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.050144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:25.050144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.050619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:25.186553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:25.195431 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:25.196981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:25.198141 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6b85077f-19a6-4753-b24c-a8656fa4558b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1724 microversion: 2.20 time: 0.161975 May 31 22:38:25.198710 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 236/474] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:25 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:25.216997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c59b88e-899f-475c-a112-ac445687193d"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:25.218106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:25.224074 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.225071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:25.225839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.226277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:25.961628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:25.962225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:25.968107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.968549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:25.969297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:25.969724 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:26.096602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:26.100019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:26.104324 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed24689a-dbc5-4197-923e-9f0c3da708d8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.147098 May 31 22:38:26.104893 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 237/475] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:25 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:26.164994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ace019f7-aefa-4d7f-9eda-d2fe9e2e2f0f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.951869 May 31 22:38:26.165569 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 239/476] 10.222.0.39 () {62 vars in 1363 bytes} [Tue May 31 22:38:25 2022] POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments => generated 188 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:38:26.274763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:26.275344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:26.281413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:26.281863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:26.282619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:26.283120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:26.494731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4f318422-6c51-43b1-ac6a-a87a822b3330 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/action" status: 202 len: 0 microversion: 2.20 time: 0.224790 May 31 22:38:26.495360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 238/477] 10.222.0.39 () {62 vars in 1318 bytes} [Tue May 31 22:38:26 2022] POST /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 22:38:26.503409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:26.504020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:26.510770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:26.511251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:26.512082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:26.512524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:26.643086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:26.652109 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:26.653738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:26.654949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8077e9f3-e092-4766-889f-30817f0f4483 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1750 microversion: 2.20 time: 0.155333 May 31 22:38:26.655681 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 240/478] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:26 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:27.125157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:27.125845 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:27.132421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:27.132868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:27.133622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:27.134051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:27.267770 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:27.275508 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-799be491-e229-45e5-be9e-bb3f49ec7585 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.154565 May 31 22:38:27.276078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 239/479] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:27 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:27.673682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:27.674280 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:27.681008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:27.681458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:27.682269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:27.682626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:27.818679 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:27.835004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:27.836975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:27.839388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e9ff669d-081b-4bc5-876b-2cea2fab92ce tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1750 microversion: 2.20 time: 0.168654 May 31 22:38:27.854807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 241/480] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:27 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:28.292849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:28.293487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:28.300017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:28.300458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:28.301208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:28.301643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:28.432020 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:28.439363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9c7212eb-d04f-440e-aec5-e8e306b8a7f8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.150459 May 31 22:38:28.439929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 240/481] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:28 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:28.863926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:28.865723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:28.876761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:28.877204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:28.878049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:28.878484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:29.009800 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:29.018382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:29.020089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:29.021279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-90cd503c-50f3-4338-a797-a73162354c99 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1750 microversion: 2.20 time: 0.162345 May 31 22:38:29.021990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 242/482] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:28 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:29.456231 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:29.456835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:29.463521 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:29.463969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:29.464749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:29.466213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:29.671791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:29.679109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-44bde17d-5663-48d3-9bba-0fe321327982 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.226874 May 31 22:38:29.679947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 241/483] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:29 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:30.040056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:30.040860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:30.049660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:30.050101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:30.050925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:30.051358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:30.066490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:30.183678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:30.192294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:30.194043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:30.195307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c7adf342-ade0-43b9-b86d-31e2b4e4ce0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.159564 May 31 22:38:30.195952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 243/484] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:30 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:30.702698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:30.702698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:30.705381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:30.705893 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:30.706593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:30.707173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:30.895565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:30.903414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9c50e2c1-409e-4db0-9634-13e46dbbc0dd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.211262 May 31 22:38:30.904120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 242/485] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:30 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:31.213869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:31.214770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:31.221441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:31.221832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:31.222591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:31.223053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:31.355343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:31.363771 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:31.365905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:31.367069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87063686-91d0-4f42-8469-9dda0a931035 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.157381 May 31 22:38:31.367909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 244/486] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:31 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:31.920588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:31.921206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:31.928628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:31.929076 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:31.930111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:31.930545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:32.071118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:32.078585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3758c1b9-47a1-407b-9e7c-f27a8523d7f1 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.162095 May 31 22:38:32.079352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 243/487] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:31 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:32.385429 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:32.386073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:32.392524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:32.392976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:32.393744 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:32.394185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:32.526605 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:32.534986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:32.536515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:32.537690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e08d82a-2a5b-4c7a-a01b-b95923482520 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.156767 May 31 22:38:32.538254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 245/488] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:32 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:33.095711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:33.096329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:33.103528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:33.103983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:33.104749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:33.105189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:33.237019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:33.244574 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1db49584-1a0c-4e3d-b29f-23393ff4ecd0 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.152661 May 31 22:38:33.245144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 244/489] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:33 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:33.555254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:33.555861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:33.562342 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:33.562809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:33.563582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:33.564023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:33.688125 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:33.697033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:33.698552 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:33.699723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87cb5b98-dc2a-4351-9dc7-6c91efd3b56f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.148690 May 31 22:38:33.700284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 246/490] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:33 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:34.260752 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:34.261272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:34.267677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:34.268099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:34.270931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:34.270931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:34.402605 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:34.410163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a4ca359f-5556-4cf0-9fdd-6e410111c1fb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.153394 May 31 22:38:34.413093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 245/491] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:34 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:34.717642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:34.718255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:34.724700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:34.725166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:34.726609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:34.730561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:34.857580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:34.866476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:34.868005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:34.869141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c4fee61d-65a1-4968-96f3-82ee21a2699f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.155563 May 31 22:38:34.869686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 247/492] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:34 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:35.430031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:35.430643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:35.437492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:35.437949 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:35.438765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:35.439230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:35.569033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:35.577744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d65640d5-a0cb-4509-bfc5-bf4cbf4900c5 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.152293 May 31 22:38:35.578315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 246/493] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:35 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:35.887273 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:35.887873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:35.894450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:35.894930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:35.895690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:35.896126 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:36.020784 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:36.029073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:36.030578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:36.031735 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-37a24757-afff-4cd2-95e8-f4a7188da331 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.148355 May 31 22:38:36.032297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 248/494] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:35 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:36.594635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:36.595200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:36.601529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:36.601977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:36.602725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:36.603258 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:36.734112 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:36.741655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a049d8d8-baf7-4c49-a974-6033feed4a6e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.150820 May 31 22:38:36.742232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 247/495] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:36 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:37.049599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:37.050211 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:37.057425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:37.057876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:37.058643 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:37.059110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:37.182812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:37.191224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:37.192747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:37.193890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b7fe65c6-3cd1-4c55-8ad6-8e19d0a9318d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.148395 May 31 22:38:37.194458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 249/496] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:37 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:37.758423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:37.758965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:37.765434 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:37.765906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:37.766658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:37.767128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:37.897157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:37.905401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89dd553e-7b77-497a-9e8f-009a40800523 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.151026 May 31 22:38:37.905971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 248/497] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:37 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:38.212604 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:38.213202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:38.219763 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:38.224807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:38.224807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:38.224807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:38.354227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:38.362630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:38.364192 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:38.365328 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-553e656c-7037-4a12-89af-05074ae868ee tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.157263 May 31 22:38:38.365884 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 250/498] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:38 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:38.922113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:38.922714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:38.930532 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:38.931009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:38.931798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:38.932257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:39.065720 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:39.073187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f0be97e7-cf9f-43f4-b446-ade9028e6a27 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.155003 May 31 22:38:39.073754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 249/499] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:38 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:39.384353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:39.384967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:39.391419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:39.391866 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:39.392630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:39.393106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:39.524870 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:39.533412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:39.534983 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:39.536123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d51dae7c-1c24-45f0-8c7c-dec177faecb9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.156298 May 31 22:38:39.536666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 251/500] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:39 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:40.089505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:40.090114 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:40.096617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.097069 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.097842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.098269 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.230798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:40.238430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-18818258-bcd5-4ea2-9eaf-cc087218f962 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.152785 May 31 22:38:40.239023 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 250/501] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:40 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:40.558932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:40.558932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:40.572655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:40.573268 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:40.575328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=88 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:40.578179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.578834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.579588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.579970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.581022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.581712 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.582572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:40.583054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:40.723341 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:40.733718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:40.735542 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:40.736545 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1f458c24-9557-41db-a403-d8b9654d0fbb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1752 microversion: 2.20 time: 0.186248 May 31 22:38:40.737340 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 252/502] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:40 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:40.739441 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:40.748157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dc49927e-274c-46f2-b0b6-c61e3a3a0476 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1592 microversion: 2.1 time: 0.179328 May 31 22:38:40.748727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 251/503] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:40 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1592 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:41.053762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:41.054602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:41.060701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.061147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.062826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.062826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.224649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lazy-loading 'services' on Instance uuid bcf784e1-991c-4661-8d71-f0a9b262410e {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:38:41.256019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:41.257840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:41.264600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.265043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.266080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.266669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.432111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:41.439638 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-397c0f02-75b4-4e80-8e90-f2ceba2c1bd9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.187791 May 31 22:38:41.440393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 252/504] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:41 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:41.526287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e772743c-0d54-460c-9d01-6d764d99bae0 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e/os-volume_attachments/0fde505f-6b73-4c24-8d15-fcfad033b9d2" status: 202 len: 0 microversion: 2.1 time: 0.476822 May 31 22:38:41.526900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 253/505] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:38:41 2022] DELETE /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e/os-volume_attachments/0fde505f-6b73-4c24-8d15-fcfad033b9d2 => generated 0 bytes in 478 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:38:41.755092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:41.755699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:41.762688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.763295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.764158 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:41.764730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:41.790871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:41.922716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:41.932923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:41.934471 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:41.935654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a0560951-ff2f-48f3-a7fb-2bd23826002e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.184683 May 31 22:38:41.936335 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 253/506] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:41 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:42.459247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:42.462359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:42.478915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:42.479437 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:42.480295 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:42.480799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:42.743734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:42.751946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc3e7dcd-9421-4a8b-ba87-047466955695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.298141 May 31 22:38:42.753051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 254/507] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:42 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:42.795569 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-8b638e49-f3c7-4cfc-99c9-ce63f9b39be9 req-bdcbd021-c039-4ff8-8c68-c0456ae8303b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "name": "network-vif-plugged", "status": "completed", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:42.812921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-8b638e49-f3c7-4cfc-99c9-ce63f9b39be9 req-bdcbd021-c039-4ff8-8c68-c0456ae8303b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:42.817587 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-8b638e49-f3c7-4cfc-99c9-ce63f9b39be9 req-bdcbd021-c039-4ff8-8c68-c0456ae8303b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:42.833297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-8b638e49-f3c7-4cfc-99c9-ce63f9b39be9 req-bdcbd021-c039-4ff8-8c68-c0456ae8303b service nova] Creating event network-vif-plugged:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:38:42.838660 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-8b638e49-f3c7-4cfc-99c9-ce63f9b39be9 req-bdcbd021-c039-4ff8-8c68-c0456ae8303b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048756 May 31 22:38:42.841250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 254/508] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:42.953581 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:42.954195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:42.961642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:42.964995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:42.964995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:42.964995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.229331 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:43.238208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:43.240071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:43.242029 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-455f6f15-769d-476d-bda8-4689b7c104d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.291898 May 31 22:38:43.251399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 255/509] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:42 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:43.435208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-d0048bb8-0504-4569-84ba-cb71517e1eb6 req-60339f6c-1efe-4223-82a0-c67fd5285b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:43.447047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d0048bb8-0504-4569-84ba-cb71517e1eb6 req-60339f6c-1efe-4223-82a0-c67fd5285b41 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:43.447493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-d0048bb8-0504-4569-84ba-cb71517e1eb6 req-60339f6c-1efe-4223-82a0-c67fd5285b41 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.459027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-d0048bb8-0504-4569-84ba-cb71517e1eb6 req-60339f6c-1efe-4223-82a0-c67fd5285b41 service nova] Creating event network-changed:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:38:43.464039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-d0048bb8-0504-4569-84ba-cb71517e1eb6 req-60339f6c-1efe-4223-82a0-c67fd5285b41 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038473 May 31 22:38:43.465133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 255/510] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:43.770166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:43.770575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:43.771315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:43.776529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:43.778464 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:43.779024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.779993 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:43.780416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.780831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:43.781448 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.783068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:43.783666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:43.810727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:38:43.969930 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:43.981890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c1b35531-143a-469a-8582-8b7511314c0a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.215651 May 31 22:38:43.982478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 256/511] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:43 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:44.178600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d8c0d97c-6c5a-4bf8-8f23-36a105b26695 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 204 len: 0 microversion: 2.1 time: 0.415787 May 31 22:38:44.179741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 256/512] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:38:43 2022] DELETE /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:38:44.190341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:44.191158 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:44.201494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:44.201971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:44.202742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:44.203199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:44.261630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:44.262336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:44.268615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:44.269301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:44.270244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:44.270883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:44.394073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:44.402811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a0e0a0fa-bf2d-4807-a0e6-5bdf15d8a947 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.217855 May 31 22:38:44.404007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 257/513] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:44 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:44.474635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:44.477494 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:44.484306 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:44.486058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:44.487229 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-150fdd77-ad8f-41d5-9469-ad321a76052a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.230487 May 31 22:38:44.487792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 257/514] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:44 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:44.998944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:44.999560 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:45.006360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.006898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.007671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.008111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.188720 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:45.196228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2c907ff3-c74f-4be4-bdd3-1e5bc9f08b97 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.201270 May 31 22:38:45.196791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 258/515] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:44 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:45.420963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:45.421721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:45.424077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:45.429458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.429903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.430659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.431115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.506221 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:45.506334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:45.513084 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.513527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.514331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:45.514804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:45.570346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:45.579174 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb6714cb-f27b-42bf-af50-701135fbaf77 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.162456 May 31 22:38:45.579765 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 258/516] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:45 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:45.665679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:45.679540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:45.679540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:45.679540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dfec1735-6078-4002-be52-e2bbc8f3c25e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.175413 May 31 22:38:45.679941 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 259/517] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:45 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:46.213515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:46.214111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:46.221442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.221885 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.222657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.223118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.332173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1815953928"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:46.332710 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:46.339060 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.339502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.340255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.340682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.357743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:46.376381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b0828ab6-04f1-42eb-a7d1-8c1af2730db9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1259 microversion: 2.1 time: 0.156556 May 31 22:38:46.376381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 259/518] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:46 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:46.468648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.network.security_group_api [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Adding security group cf34fcd8-632a-443b-8e0b-51342ed8510d to port dd4dada1-fee7-4496-8e97-d81ad342e789 May 31 22:38:46.600289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:46.603204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:46.612272 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.613074 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.614310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.616721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.758953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:46.766518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9a1b0bcc-3ef1-4031-9959-7e9c7a53a0b6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.173390 May 31 22:38:46.767123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 260/519] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:46 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:46.772014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:46.773546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:46.781433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.781919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.782692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:46.783156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:46.931326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:46.939691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:46.941199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:46.942344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6ab8b48f-15da-4e48-8d41-e9f19cbd3af0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.174067 May 31 22:38:46.942927 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 261/520] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:46 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:47.013529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fb784516-015d-44b5-8cbb-ec71b2f32514 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action" status: 202 len: 0 microversion: 2.1 time: 0.685236 May 31 22:38:47.023264 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 260/521] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:38:46 2022] POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action => generated 0 bytes in 687 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 22:38:47.030870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-1f9e0354-1816-4c17-b8ab-58ce70392452 req-de96d2c6-2196-494e-8cb1-4137b99dbf32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:47.036734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:47.037351 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:47.053739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1f9e0354-1816-4c17-b8ab-58ce70392452 req-de96d2c6-2196-494e-8cb1-4137b99dbf32 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.054713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1f9e0354-1816-4c17-b8ab-58ce70392452 req-de96d2c6-2196-494e-8cb1-4137b99dbf32 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.058982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.063396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.072253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.072253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.082711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-1f9e0354-1816-4c17-b8ab-58ce70392452 req-de96d2c6-2196-494e-8cb1-4137b99dbf32 service nova] Creating event network-changed:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:38:47.089671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-1f9e0354-1816-4c17-b8ab-58ce70392452 req-de96d2c6-2196-494e-8cb1-4137b99dbf32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066360 May 31 22:38:47.090901 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 261/522] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:47.378567 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:47.385451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:47.386221 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:47.391172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a7445fd1-f961-4473-9ebd-02e931431d6a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1639 microversion: 2.1 time: 0.365965 May 31 22:38:47.392675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 262/523] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:47 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1639 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:47.398260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.399927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.401672 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.403100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.567405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:47.580827 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-108967ef-600a-4c50-82e5-fcaeded60bd8 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1443 microversion: 2.1 time: 0.198166 May 31 22:38:47.582946 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 262/524] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:47 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1443 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:47.605135 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:47.607256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:47.619738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.620797 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.622879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.625081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.786475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:47.787454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:47.788292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:47.799024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82f5ba33-4284-4ab9-b49e-55a005454610 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1443 microversion: 2.1 time: 0.203874 May 31 22:38:47.801689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.802341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.803788 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 263/525] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:47 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1443 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:47.804957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.807197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.970177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:47.971011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:47.981642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.983283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:47.984964 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:47.985808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:48.056567 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:48.065490 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af18d7cc-7ace-4893-80b2-846fa42bc04f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.283227 May 31 22:38:48.066533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 263/526] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:47 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:48.188555 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:48.198378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:48.199936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:48.201099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4fbc2422-f1d8-4bbd-9345-bad417c4aeaa tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.244296 May 31 22:38:48.202093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 264/527] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:47 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:49.085745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:49.087163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:49.094854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:49.095590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:49.096558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:49.097161 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:49.219524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:49.220139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:49.226825 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:49.227347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:49.228198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:49.228720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:49.276861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:49.285125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e38c24ff-4a83-43b1-bab5-ccb2cc1066a9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.205874 May 31 22:38:49.285734 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 264/528] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:49 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:49.383458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:49.392538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:49.394057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:49.395246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e6ee7443-0b58-40bc-865a-1a4c0f092585 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.179966 May 31 22:38:49.396316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 265/529] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:49 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:50.276966 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f6385b9e-79e0-41d0-8292-eb23b9a8c818 req-7e52b96c-d275-40c8-9303-05c191e8f182 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:38:50.286753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f6385b9e-79e0-41d0-8292-eb23b9a8c818 req-7e52b96c-d275-40c8-9303-05c191e8f182 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:50.301052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f6385b9e-79e0-41d0-8292-eb23b9a8c818 req-7e52b96c-d275-40c8-9303-05c191e8f182 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:50.301052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f6385b9e-79e0-41d0-8292-eb23b9a8c818 req-7e52b96c-d275-40c8-9303-05c191e8f182 service nova] Creating event network-changed:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:38:50.304956 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:50.305475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f6385b9e-79e0-41d0-8292-eb23b9a8c818 req-7e52b96c-d275-40c8-9303-05c191e8f182 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032044 May 31 22:38:50.307069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:50.308980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 265/530] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:38:50.316003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:50.316862 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:50.318398 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:50.319982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:50.414815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:50.415522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:50.428373 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:50.429778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:50.430576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:50.431060 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:50.512384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:50.522856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7ad2f344-2287-4514-b62f-d23371da627a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.224677 May 31 22:38:50.524138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 266/531] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:50 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:38:50.624849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:50.635176 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:50.637208 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:50.638590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1e82048d-9dff-4122-917c-3f4eae8068b2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.227959 May 31 22:38:50.639173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 266/532] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:50 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:51.540148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:51.540937 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:51.547916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:51.548621 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:51.549693 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:51.550129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:51.666975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:51.669835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:51.677681 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:51.678521 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:51.680658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:51.681293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:51.707205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:51.717061 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b5b952c8-50f1-4091-9034-0ea9fdbb7945 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.180699 May 31 22:38:51.718967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 267/533] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:51 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:51.831007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:51.839361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:51.840867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:51.841994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3aa013b4-94bb-4435-bc54-0196418e167b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.185835 May 31 22:38:51.842548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 267/534] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:51 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:52.734652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:52.735310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:52.741824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:52.742283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:52.743074 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:52.743510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:52.860122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:52.860693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:52.867322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:52.867765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:52.868529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:52.868957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:52.869589 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:52.877113 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-952e2f19-f430-4217-b264-fca1682caac1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.146455 May 31 22:38:52.877673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 268/535] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:52 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:53.005938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:53.015748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:53.017665 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:53.019136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-923d3730-8fa1-4564-94e6-5d8f6543765a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.162980 May 31 22:38:53.020418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 268/536] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:52 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:53.893448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:53.894051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:53.900470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:53.900904 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:53.901655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:53.902085 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:54.038373 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:54.038988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:54.045437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:54.045958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:54.046827 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:54.047525 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:54.051408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:54.060382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c2745845-3751-498b-8882-509fe0886f03 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.170699 May 31 22:38:54.061338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 269/537] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:53 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:54.140902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:38:54.142649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:38:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb (ip 10.222.0.39) !!! May 31 22:38:54.183344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:54.192051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:54.194178 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:54.194806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-50fdb8b7-852d-4429-a767-aff525541cd5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.160839 May 31 22:38:54.195392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 269/538] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:54 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:55.077746 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:55.078362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:55.085393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:55.085842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:55.086609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:55.087079 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:55.214128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:55.214728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:55.219524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:55.221747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:55.222194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:55.222985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:55.223594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:55.227368 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7dabef3b-38f7-4ad4-827c-ca903ef51efc tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.153452 May 31 22:38:55.228117 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 270/539] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:55 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:55.361238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:55.369647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:55.371279 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:55.372423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f362aa58-1d67-4fa1-bcc9-3a51d1c69ded tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.163536 May 31 22:38:55.372984 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 270/540] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:55 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:56.245169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:56.245781 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:56.252506 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:56.252961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:56.253726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:56.254163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:56.387010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:56.391114 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:56.392432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:56.395975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bfbbf2d3-2adc-4edb-9e79-4f1f54af29f6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.155017 May 31 22:38:56.396764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 271/541] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:56 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:56.400931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:56.401384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:56.402200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:56.402687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:56.577202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:56.587373 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:56.588929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:56.590107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0cdc39ed-42d3-478c-9936-ebd6daabd429 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.203043 May 31 22:38:56.590696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 271/542] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:56 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:38:57.414069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:57.416821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:57.421193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:57.421638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:57.422403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:57.422872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:57.549738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:57.558261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a25d084-568a-4b95-994b-5ad3be277091 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.148639 May 31 22:38:57.558854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 272/543] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:57 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:57.607990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:57.608596 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:57.615641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:57.616682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:57.617516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:57.617957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:57.768578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:57.777424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:57.779002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:57.780154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a63a4c74-65aa-4100-abea-5658fa2c3a2d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.176107 May 31 22:38:57.780746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 272/544] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:57 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:58.575662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:58.576423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:58.583066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:58.583519 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:58.584298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:58.584783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:58.728437 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:58.736098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-826f57b8-7610-4fac-bee2-9c55a95c0ca3 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.164514 May 31 22:38:58.736667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 273/545] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:58 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:58.798339 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:58.798900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:58.806213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:58.806657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:58.807437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:58.807920 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:58.811907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:58.941427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:58.949702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:58.951230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:58.952374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b87b6946-8e42-4981-9517-e4c0886c8507 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.157968 May 31 22:38:58.952938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 273/546] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:58 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:38:59.753878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:59.754537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:59.761610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:59.762055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:59.762834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:59.763275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:59.778149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:38:59.904902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:38:59.912740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82da344f-6a0c-4575-ae7f-b33d89b484cd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.162693 May 31 22:38:59.913300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 274/547] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:38:59 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:38:59.969405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:38:59.969976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:38:59.976968 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:59.977424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:38:59.978204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:38:59.978647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:00.108369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:00.116714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:00.118394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:00.119568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b64ebac-8faf-4664-91a3-8ff6e55e3ef5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.154121 May 31 22:39:00.120127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 274/548] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:38:59 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:00.930205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:00.930834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:00.937313 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:00.937756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:00.938513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:00.938973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:01.067805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:01.075852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57326294-ad4f-4467-8722-01d64ab607e6 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.150275 May 31 22:39:01.076415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 275/549] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:00 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:01.137876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:01.138477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:01.144917 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:01.145358 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:01.146111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:01.146541 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:01.275415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:01.283766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:01.285266 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:01.286400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5031eb61-b5dc-43a0-a5bc-3c8bc5e84421 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.152376 May 31 22:39:01.286986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 275/550] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:01 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:01.613210 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:01.613740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:01.619775 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:01.620228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:01.620999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:01.621436 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:01.731300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lazy-loading 'services' on Instance uuid 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:01.947967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc76d873-fd3a-4548-bb36-ed63fe5a1e9e tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments/9612a747-9fc7-4bff-bf94-61eccb98bdde" status: 202 len: 0 microversion: 2.1 time: 0.338634 May 31 22:39:01.949250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 276/551] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:39:01 2022] DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments/9612a747-9fc7-4bff-bf94-61eccb98bdde => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:02.095134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:02.096186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:02.103016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:02.103780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:02.104776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:02.105446 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:02.306129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:02.306902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:02.313439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:02.313889 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:02.314658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:02.315274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:02.315679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:02.325398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7cd220d3-e9e9-47de-a78f-8934f7e536b2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1514 microversion: 2.1 time: 0.236159 May 31 22:39:02.325977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 276/552] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:02 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:02.452482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:02.461736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:02.463367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:02.464602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d82731a3-1fb3-4a49-9daa-05fa95937419 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.163866 May 31 22:39:02.465163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 277/553] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:02 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:02.482545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-a2a9026b-a78f-4464-96e4-88090ae0cd93 req-408aa1ac-b918-466f-b8e1-75e82f427e6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bcf784e1-991c-4661-8d71-f0a9b262410e", "name": "network-vif-deleted", "tag": "f739c0e7-71dc-482d-a0c5-4cc8bbfebe38"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:02.490548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-a2a9026b-a78f-4464-96e4-88090ae0cd93 req-408aa1ac-b918-466f-b8e1-75e82f427e6f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:02.491055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-a2a9026b-a78f-4464-96e4-88090ae0cd93 req-408aa1ac-b918-466f-b8e1-75e82f427e6f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:02.501815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-a2a9026b-a78f-4464-96e4-88090ae0cd93 req-408aa1ac-b918-466f-b8e1-75e82f427e6f service nova] Creating event network-vif-deleted:f739c0e7-71dc-482d-a0c5-4cc8bbfebe38 for instance bcf784e1-991c-4661-8d71-f0a9b262410e on hv-cinder-84414 May 31 22:39:02.508264 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-a2a9026b-a78f-4464-96e4-88090ae0cd93 req-408aa1ac-b918-466f-b8e1-75e82f427e6f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029308 May 31 22:39:02.509137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 277/554] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:03.063828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5347e1c8-f387-49ee-8092-766ef9e9a7d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:03.071003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5347e1c8-f387-49ee-8092-766ef9e9a7d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.071448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5347e1c8-f387-49ee-8092-766ef9e9a7d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.092521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5347e1c8-f387-49ee-8092-766ef9e9a7d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Going to try to stop instance {{(pid=124590) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 31 22:39:03.324962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5347e1c8-f387-49ee-8092-766ef9e9a7d0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.264851 May 31 22:39:03.325478 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 278/555] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:39:03 2022] POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:03.334608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:03.335365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:03.341748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.342198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.342995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.343434 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.343556 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:03.344272 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:03.351791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.352931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.353362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.353803 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.387000 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.387452 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.387900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lazy-loading 'fault' on Instance uuid bcf784e1-991c-4661-8d71-f0a9b262410e {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:03.433635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:03.443134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9c8ed282-bdc3-448c-a335-439455ebeecd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 200 len: 1309 microversion: 2.1 time: 0.103750 May 31 22:39:03.444873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 279/556] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:03 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:03.481226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:03.483403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:03.484074 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:03.488819 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b81c74ea-0dbd-4a74-a374-a83433aa7700 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.158939 May 31 22:39:03.490598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 278/557] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:03 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:03.491578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.492247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.493031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:03.493463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:03.627465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:03.635926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:03.637416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:03.638901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f1f435cc-9a19-42fb-a494-da329dcec250 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.159405 May 31 22:39:03.639457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 280/558] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:03 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:04.461226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:04.461753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: bcf784e1-991c-4661-8d71-f0a9b262410e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:04.468280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.468729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.469488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.469926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.482905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] HTTP exception thrown: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Request method failure captured: May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e HTTP/1.1 May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpiJBdq2jZW2_PRzR40j2PZ4IaPDI1s-7KXvRnkT1t6sxapjpQLiHE-O5oHW3-6iqBUYX-9ALy2ZLZ4hNQkWfEpPVY9ak8xyzufdiyJk934V8qC2_iVNJQSMnhWero4CDTeYQ_RBWgNaWbQt3yOqV5SyZy14kSliMD-uoZ0rWGA5ugI May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 7b4d8319cf5c4c9299d8e212e286df6a May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:39:04.484542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7b4d8319cf5c4c9299d8e212e286df6a"}]}] May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 7b4d8319cf5c4c9299d8e212e286df6a May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesSnapshotTestJSON-1223377603-project May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: aec2e49221754396968ec5df0f53525f May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesSnapshotTestJSON-1223377603-project May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. May 31 22:39:04.486162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'bcf784e1-991c-4661-8d71-f0a9b262410e'} May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:39:04.487034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. May 31 22:39:04.488749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:04.489862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Returning 404 to user: Instance bcf784e1-991c-4661-8d71-f0a9b262410e could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:39:04.489862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed775f80-1d9d-4076-982f-8c70ae938ff9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e" status: 404 len: 111 microversion: 2.1 time: 0.029297 May 31 22:39:04.489862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 279/559] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:04 2022] GET /compute/v2.1/servers/bcf784e1-991c-4661-8d71-f0a9b262410e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:39:04.509214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:04.510090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:04.516524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.516973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.517744 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.518178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.652588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:04.656811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:04.657421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:04.660399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f23201e2-2ea5-40e0-96ad-c69cacce99f6 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.157429 May 31 22:39:04.660971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 281/560] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:04 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:04.663501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.663947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.664715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:04.665150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:04.797085 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:04.806202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:04.807724 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:04.808867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-eb166088-a7d4-49df-b8b7-ee09a7e0bf02 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.156068 May 31 22:39:04.809477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 280/561] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:04 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:05.678458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:05.679440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:05.685799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:05.686239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:05.687024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:05.687455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:05.813902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:05.821802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7f45cd1f-7e46-4df0-9ec4-4104a1c4561a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.147171 May 31 22:39:05.822653 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 282/562] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:05 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:05.826617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:05.827295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:05.833758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:05.834193 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:05.835586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:05.836074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:05.965542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:05.974001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:05.975858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:05.977009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c1a00fef-8d69-4d1a-8241-ad2ba88078ad tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.154302 May 31 22:39:05.977565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 281/563] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:05 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:06.839264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:06.839868 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:06.846389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:06.846858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:06.847612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:06.848046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:06.976626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:06.983969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ab0727b7-df2d-4280-aebc-c80f5f87dc58 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.149070 May 31 22:39:06.984566 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 283/564] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:06 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:06.995270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:06.995886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:07.002352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:07.002916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:07.003620 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:07.004061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:07.130278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:07.138683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:07.140234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:07.141385 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-65b2810d-f598-47e1-a743-80ce66114531 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.150063 May 31 22:39:07.141951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 282/565] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:06 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:08.000845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:08.001461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:08.007870 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:08.008311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:08.009061 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:08.009490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:08.135024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:08.142397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9ba4f6f7-8e7d-444f-bc36-7baaa0e5bb7a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.145407 May 31 22:39:08.142994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 284/566] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:07 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:08.159743 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:08.160351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:08.167277 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:08.167726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:08.168487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:08.168923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:08.299624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:08.308254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:08.309788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:08.310961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0b258b60-66c2-4aab-aa24-ca6373fad198 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.155075 May 31 22:39:08.311513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 283/567] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:08 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:09.159329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:09.160142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:09.169638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:09.169638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:09.169638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:09.169638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:09.298534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:09.306618 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2ba71ade-3694-47fd-9568-4587aa668d82 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.151099 May 31 22:39:09.307301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 285/568] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:09 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:09.328806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:09.329414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:09.335906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:09.336354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:09.337117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:09.337553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:09.465218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:09.473776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:09.475329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:09.476995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4debc57b-0d74-452e-b375-61c549535812 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.152018 May 31 22:39:09.477572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 284/569] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:09 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:10.324086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:10.324597 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:10.331222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.331673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.332419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.332875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.461156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:10.469048 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7a25039f-3887-42bd-9492-25902582cd1a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.148897 May 31 22:39:10.469603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 286/570] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:10 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:10.495573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:10.496246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:10.502871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.503257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.504025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.504464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.623365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:10.623867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:10.630864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.631549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.632613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.633129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.648036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:10.659813 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d46a3cc8-a1e2-4b33-9e09-b3107c6d44f3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/ips" status: 200 len: 151 microversion: 2.1 time: 0.040445 May 31 22:39:10.660119 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 287/571] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:39:10 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:39:10.669455 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:10.671263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:10.675714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1386a4f-7269-42f9-86cf-3be2e6fe05a6"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:10.675714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:10.675973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7eaf4b1e-41d8-4e44-bf45-997aeb30dacb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.181551 May 31 22:39:10.675973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 285/572] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:10 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:10.679288 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.680082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.680916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.681412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.764175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/os-volume_attachments HTTP/1.1 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 74 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:39:10.766890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {"volumeAttachment": {"volumeId": "a1386a4f-7269-42f9-86cf-3be2e6fe05a6"}} May 31 22:39:10.768205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '20693ef7-74d7-4abb-8e36-5390380de3c8', 'body': {'volumeAttachment': {'volumeId': 'a1386a4f-7269-42f9-86cf-3be2e6fe05a6'}}} May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:10.769179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:10.770327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 400 to user: Invalid volume: volume a1386a4f-7269-42f9-86cf-3be2e6fe05a6 is already attached to instances: c60508e7-6ac1-4814-99ee-6e8d1d4e2057 {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:39:10.771536 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2dc753b9-9f50-4791-bcf1-bcc48f4b302d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101160 May 31 22:39:10.773316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 288/573] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:39:10 2022] POST /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8/os-volume_attachments => generated 174 bytes in 106 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 31 22:39:10.778143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:10.778705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:10.780671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=70 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:10.786384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.786384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.787119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:10.787554 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:10.813140 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:39:11.131365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-19c7a06c-bb5c-410a-802c-468d1430a29c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 204 len: 0 microversion: 2.1 time: 0.356494 May 31 22:39:11.132426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 286/574] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:39:10 2022] DELETE /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:39:11.140458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:11.141058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:11.146976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.148013 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.148767 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.149198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.164147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:11.277243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:11.284766 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-94a40cb1-4a04-4c2b-8b5b-bb5ea39970c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1682 microversion: 2.1 time: 0.148138 May 31 22:39:11.285343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 289/575] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:11 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:11.487268 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:11.487959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:11.494367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.494831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.495584 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.496108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.622907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:11.630274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d84fa0b0-1050-427d-9ef5-ca4deb25a1aa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.147250 May 31 22:39:11.630859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 287/576] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:11 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:11.692200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:11.692805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:11.699655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.700105 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.700858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:11.701339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:11.839623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:11.847996 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:11.849510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:11.851186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57d58de1-1e68-406b-a861-58dffe8f5a39 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.162762 May 31 22:39:11.851738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 290/577] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:11 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:12.301450 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:12.302106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:12.308287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.308729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.309481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.309906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.438395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:12.446263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0d1d53ad-cfd1-4621-ad37-40a7074d2337 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1682 microversion: 2.1 time: 0.148728 May 31 22:39:12.446828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 288/578] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:12 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:12.648649 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:12.649166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:12.655186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.655631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.656385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.656822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.780323 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:12.787833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4ea263e4-85d7-4f18-bcfd-fb52238527f5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.143820 May 31 22:39:12.788392 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 291/579] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:12 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:12.869475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:12.870078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:12.876494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.876937 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.877690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:12.878118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:12.896083 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:13.004518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:13.013483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:13.015027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:13.016177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b38e560a-1dcf-4836-8d06-26663730d7c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.151116 May 31 22:39:13.016730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 289/580] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:13.464216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:13.464860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:13.471163 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:13.471640 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:13.472435 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:13.472875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:13.602068 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:13.610834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5150ca2e-069e-4b19-b227-a4d6264a5b8a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1682 microversion: 2.1 time: 0.150361 May 31 22:39:13.611352 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 292/581] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:13 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:13.804947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:13.805554 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:13.811669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:13.812117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:13.812875 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:13.813312 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:13.938895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:13.946988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5b2fedf4-6d08-4eea-9565-843c3852b3e3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.146251 May 31 22:39:13.947545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 290/582] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:13 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:14.033310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:14.033959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:14.040229 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.040671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.041461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.041897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.167952 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:14.176819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:14.178266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:14.179696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cee0f9f3-f100-4ef3-a324-af4d8bf81f24 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.150254 May 31 22:39:14.180253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 293/583] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:14 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:14.628425 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:14.629037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:14.635936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.636379 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.637143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.637573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.904108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:14.914862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-67c3244d-2d8f-4cf0-85a7-d99ea6903e17 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1682 microversion: 2.1 time: 0.290119 May 31 22:39:14.915619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 291/584] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:14 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1682 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:14.965671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:14.968480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:14.976586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.977293 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.978292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.979012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:14.981909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-6870520e-e1f4-4d78-aced-ee48d68e522e req-697f1522-6c68-492a-ae6c-b93f45363a05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "name": "network-vif-plugged", "status": "completed", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:14.993858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6870520e-e1f4-4d78-aced-ee48d68e522e req-697f1522-6c68-492a-ae6c-b93f45363a05 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:14.994318 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6870520e-e1f4-4d78-aced-ee48d68e522e req-697f1522-6c68-492a-ae6c-b93f45363a05 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.006581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-6870520e-e1f4-4d78-aced-ee48d68e522e req-697f1522-6c68-492a-ae6c-b93f45363a05 service nova] Creating event network-vif-plugged:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:39:15.012020 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-6870520e-e1f4-4d78-aced-ee48d68e522e req-697f1522-6c68-492a-ae6c-b93f45363a05 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034194 May 31 22:39:15.015732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 292/585] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:39:15.089174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1471814364", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "networks": [{"uuid": "3c832d96-0150-4a1b-8007-b4291f543173"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:15.138571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:15.143141 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] validate_networks() for [('3c832d96-0150-4a1b-8007-b4291f543173', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:39:15.146265 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8352b667-1526-4ce4-898e-c825f2722638 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.185605 May 31 22:39:15.147147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 294/586] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:14 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:15.199239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:15.200251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:15.206546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.207266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.208053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.208674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.346041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:15.355992 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:15.358131 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:15.359298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-62e9b774-3158-4502-aaff-c5b537079e56 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.165851 May 31 22:39:15.359864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 295/587] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:15 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:15.659050 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-e63de151-b06f-4b03-b2c6-173fc5b5ab06 req-6ba294a1-d01e-40f0-957c-b9ebcac7ddd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20693ef7-74d7-4abb-8e36-5390380de3c8", "name": "network-vif-deleted", "tag": "3e1b5caa-a076-4fff-93dc-cba5f814d2bc"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:15.677732 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e63de151-b06f-4b03-b2c6-173fc5b5ab06 req-6ba294a1-d01e-40f0-957c-b9ebcac7ddd4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.678949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e63de151-b06f-4b03-b2c6-173fc5b5ab06 req-6ba294a1-d01e-40f0-957c-b9ebcac7ddd4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.728402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-e63de151-b06f-4b03-b2c6-173fc5b5ab06 req-6ba294a1-d01e-40f0-957c-b9ebcac7ddd4 service nova] Creating event network-vif-deleted:3e1b5caa-a076-4fff-93dc-cba5f814d2bc for instance 20693ef7-74d7-4abb-8e36-5390380de3c8 on hv-cinder-84414 May 31 22:39:15.734611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-e63de151-b06f-4b03-b2c6-173fc5b5ab06 req-6ba294a1-d01e-40f0-957c-b9ebcac7ddd4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083741 May 31 22:39:15.738108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 296/588] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:15.747412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:39:15.747844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:39:15.748570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:39:15.749152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:39:15.749770 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:39:15.760688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.761547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.762563 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.763259 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.783732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Getting quotas for project 7b4d8319cf5c4c9299d8e212e286df6a. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:39:15.788380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Getting quotas for user aec2e49221754396968ec5df0f53525f and project 7b4d8319cf5c4c9299d8e212e286df6a. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:39:15.800147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:39:15.802769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:39:15.936926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:15.937847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:15.949217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fefb2013-3116-4864-adf4-3060645f80cf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856761 May 31 22:39:15.950243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 293/589] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:39:15.950542 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.951157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.954881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:15.955492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:15.966628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-13d635fa-e626-4d3d-9ce2-a1ea5624627c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:15.973540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-13d635fa-e626-4d3d-9ce2-a1ea5624627c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:16.076202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.083786 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-13d635fa-e626-4d3d-9ce2-a1ea5624627c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.084738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eab150f3-abeb-4c33-a870-998ac7c0a885 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1326 microversion: 2.1 time: 0.152431 May 31 22:39:16.085925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 297/590] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:15 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1326 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:16.091077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-13d635fa-e626-4d3d-9ce2-a1ea5624627c tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1219 microversion: 2.1 time: 0.130224 May 31 22:39:16.091886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 294/591] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:15 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1219 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:16.164833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:16.167177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:16.173664 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.174301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.175319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.175866 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.342868 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.351445 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-07e487d2-5489-4f54-b2bb-e35eec232ad9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.190963 May 31 22:39:16.352027 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 298/592] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:16 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:16.377410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:16.378031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:16.384739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.385493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.386283 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.386934 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.540926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.557437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.560073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:16.561803 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f3d4a5b4-72de-4e0a-b05e-09f43b20c57e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.188126 May 31 22:39:16.563149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 295/593] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:16 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:16.619824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:16.621585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:16.627290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=84 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:16.629179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.630127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.630968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.631537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.849525 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d3fd6aa4-af3c-49a6-b7fd-52a86c10e241 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action" status: 202 len: 0 microversion: 2.1 time: 0.233276 May 31 22:39:16.853855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 299/594] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:39:16 2022] POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:16.859749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:16.860355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:16.879447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.879876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:16.880664 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:16.881096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.029925 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.037918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-033d2870-8d4c-4d7e-a718-cbd120ed9bd0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1750 microversion: 2.1 time: 0.182865 May 31 22:39:17.038486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 296/595] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:16 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1750 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:17.102019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:17.102990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:17.110511 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.111084 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.112129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.112579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.113702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:17.113702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:17.121230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.121873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.122898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.123336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.155415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.156194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.156801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'fault' on Instance uuid 20693ef7-74d7-4abb-8e36-5390380de3c8 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:17.185838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.194696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a24ff900-8dde-4884-8c7c-965fc4707485 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1223 microversion: 2.1 time: 0.084714 May 31 22:39:17.195502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 297/596] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:17 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:17.215124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.224029 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5af622cb-b206-4c35-9389-563ecf2d8a1b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 200 len: 1331 microversion: 2.1 time: 0.126197 May 31 22:39:17.225484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 300/597] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:17 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 1331 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:17.230655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ccad5c06-1034-4658-b9bb-0da6c6f1ff82"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:17.232328 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:17.240351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.240879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.241735 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.242201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.369315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:17.369843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:17.386446 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.386925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.387906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.388503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.551303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.560327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-62ace59f-a1cf-4be7-9a75-e02cd12008bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.195458 May 31 22:39:17.561317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 301/598] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:17 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:17.580075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:17.580792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:17.588692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.589148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.589931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:17.590637 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:17.738529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.748214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.749717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:17.750926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8e248dcf-44d7-4bfa-ab22-93eb132c41e8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.174818 May 31 22:39:17.751655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 302/599] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:17 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:18.055496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.056099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:18.062730 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.063322 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.063997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.064441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.266229 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.276469 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0df6484c-5048-4aa4-9093-fea46e30cdeb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1750 microversion: 2.1 time: 0.225169 May 31 22:39:18.277157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 303/600] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:18 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1750 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:18.281982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.282574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:18.289450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.289894 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.290915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.291346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.355782 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.363600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f8a99887-a61f-4d99-82b0-d5ca1b5b1990 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1215 microversion: 2.1 time: 0.085283 May 31 22:39:18.373832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 304/601] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:18 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1215 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:18.377745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.378608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:18.386348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.387054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.387998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.388701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.419089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 HTTP/1.1 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:39:18.421812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:39:18.423965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '20693ef7-74d7-4abb-8e36-5390380de3c8'} May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:39:18.424828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:39:18.426212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:18.429123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:39:18.430718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d778e04b-75cf-492a-a380-63b09bc463ef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 404 len: 111 microversion: 2.1 time: 0.064609 May 31 22:39:18.432644 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 305/602] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:18 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:39:18.441950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3e5bd4e6-e1d9-4ccf-aa48-8691d88a7a1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '.version_select at 0x7ff45e36dee0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.578041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3e5bd4e6-e1d9-4ccf-aa48-8691d88a7a1a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-775277751" status: 202 len: 0 microversion: 2.1 time: 0.141602 May 31 22:39:18.581908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 306/603] 10.222.0.39 () {58 vars in 1217 bytes} [Tue May 31 22:39:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-775277751 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:18.599789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.600527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:18.612554 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.612976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.613817 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.614256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.617244 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:18.740133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bb424641-8c01-4fd5-9b5d-b48941313a7c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.513219 May 31 22:39:18.746066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 298/604] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:39:17 2022] POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 194 bytes in 1519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:39:18.771252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:18.773121 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:18.782649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.783468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.784898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:18.785608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:18.823108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.834042 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8044eb02-8112-44f1-80a2-156ea1447770 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1675 microversion: 2.1 time: 0.254282 May 31 22:39:18.834915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 307/605] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:18 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1675 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:18.939585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.951779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.951779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:18.952390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8fba76bf-c0c9-4701-a9c1-ad9277d7ee38 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1808 microversion: 2.20 time: 0.187079 May 31 22:39:18.952947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 299/606] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:18 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:39:19.294860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:19.295575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:19.303298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.304973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.306235 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.306907 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.382585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:19.383216 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:19.390187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.390861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.391648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.392081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.483405 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:19.492936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-625ccd7b-6338-46af-b547-b041af3f28cd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.202212 May 31 22:39:19.493583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 308/607] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:19 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:19.515106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:19.523253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-634159e7-13c1-4d66-9f73-92b446679270 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1279 microversion: 2.1 time: 0.144964 May 31 22:39:19.524070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 300/608] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:19 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1279 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:19.852626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:19.853239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:19.859250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.859696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.860779 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.861565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.970688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:19.971253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:19.977577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.978039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:19.982406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:19.982406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.000820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.009929 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eaa3cec3-cbbe-42b3-bd29-ee4050879a18 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1652 microversion: 2.1 time: 0.161789 May 31 22:39:20.021100 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 309/609] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:19 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1652 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:20.029064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a23e47f7-747a-48ac-b8db-715348fe5a80 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:20.035519 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a23e47f7-747a-48ac-b8db-715348fe5a80 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.036136 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a23e47f7-747a-48ac-b8db-715348fe5a80 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.058954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a23e47f7-747a-48ac-b8db-715348fe5a80 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Going to try to start instance {{(pid=124590) start /opt/stack/nova/nova/compute/api.py:2730}} May 31 22:39:20.191317 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.200357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.201885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.203237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c71b708f-a924-4e59-bc90-cac2ecc5f0e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1795 microversion: 2.20 time: 0.236348 May 31 22:39:20.204746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 301/610] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:39:19 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1795 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:39:20.211616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:20.212509 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:20.212799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a23e47f7-747a-48ac-b8db-715348fe5a80 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action" status: 202 len: 0 microversion: 2.1 time: 0.189333 May 31 22:39:20.216628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 310/611] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:39:20 2022] POST /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:20.223990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.223990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.224254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:20.224340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.224416 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:20.224489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.229411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.229867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.230642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.231108 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.366709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.367338 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'services' on Instance uuid c60508e7-6ac1-4814-99ee-6e8d1d4e2057 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:20.374320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d9ac00a6-2776-4151-a09a-86b2757f2d37 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1661 microversion: 2.1 time: 0.156244 May 31 22:39:20.374905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 311/612] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:20 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:20.512621 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:20.513276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:20.519790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.520609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.521393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.521837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.628185 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dcb23659-cc94-44c2-9a86-097fa9c2d851 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments/a1386a4f-7269-42f9-86cf-3be2e6fe05a6" status: 202 len: 0 microversion: 2.1 time: 0.421901 May 31 22:39:20.628817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 302/613] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:39:20 2022] DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments/a1386a4f-7269-42f9-86cf-3be2e6fe05a6 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:20.634585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:20.635342 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:20.643107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.643107 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.650007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.650007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.757844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.766441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b2f38e67-0a0e-45d0-8bff-ab7292def817 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.259942 May 31 22:39:20.776413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 312/614] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:20 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:20.782381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:20.784351 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:20.792679 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.793374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.794372 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:20.795073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:20.840973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b1122bfc-ab97-4cfd-b7a1-4f4035a32362 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063141 May 31 22:39:20.843763 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 313/615] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:20 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:20.899033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:20.907127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2a7b9aa1-f035-44a1-bb22-414bde4fe34d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.277107 May 31 22:39:20.908014 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 303/616] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:20 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:21.393401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:21.394016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:21.400999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.401454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.402226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.402676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.532225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:21.541227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1b0d8c5a-9822-4b68-b70f-53fa0f6fefa8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1661 microversion: 2.1 time: 0.151670 May 31 22:39:21.541810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 314/617] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:21 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1661 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:21.555797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-96ad598e-9297-44b2-a198-6c0fd44fa841 req-90a9acd8-7195-4eaf-bcb1-a2dbe009ebc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6581fa26-a8f9-42ad-997e-3bd39af691fe", "tag": "ad9145cf-3ff8-46da-949c-775b67c0f4d6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:21.564322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-96ad598e-9297-44b2-a198-6c0fd44fa841 req-90a9acd8-7195-4eaf-bcb1-a2dbe009ebc2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.564756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-96ad598e-9297-44b2-a198-6c0fd44fa841 req-90a9acd8-7195-4eaf-bcb1-a2dbe009ebc2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.576190 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-96ad598e-9297-44b2-a198-6c0fd44fa841 req-90a9acd8-7195-4eaf-bcb1-a2dbe009ebc2 service nova] Creating event network-changed:ad9145cf-3ff8-46da-949c-775b67c0f4d6 for instance 6581fa26-a8f9-42ad-997e-3bd39af691fe on hv-cinder-84414 May 31 22:39:21.580758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-96ad598e-9297-44b2-a198-6c0fd44fa841 req-90a9acd8-7195-4eaf-bcb1-a2dbe009ebc2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028872 May 31 22:39:21.581347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 304/618] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:21.784052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:21.784588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:21.790631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.791127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.791929 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.792369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.853633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:21.854650 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:21.860859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.861890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.862701 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.863169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.893364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1c8a1516-4300-477a-ad92-a56e3ccc4075 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 May 31 22:39:21.893930 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 305/619] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:21 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:39:21.924423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:21.925033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:21.931542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.931994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.932760 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:21.933200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:21.933369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:21.941406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e61f893e-1290-47ca-a8f1-8fb3fe609b6e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.161585 May 31 22:39:21.941974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 315/620] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:21 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:22.075828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:22.083198 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-11ae2bad-edec-4c2c-8f9f-68e74d1ca4d2 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.162457 May 31 22:39:22.083766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 306/621] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:21 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:22.557848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:22.558422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:22.564893 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.565336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:22.566104 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.566537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:22.694453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:22.702128 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-218c2ba6-dbc0-4cd8-8a83-eb2c0af80b3c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1665 microversion: 2.1 time: 0.148552 May 31 22:39:22.702944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 316/622] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:22 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:22.905022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:22.905866 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:22.912335 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.913441 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:22.914210 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.914651 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:22.918429 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:22.942927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-63d5419f-1d4b-494c-b8e7-8429407b0087 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041943 May 31 22:39:22.943472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 307/623] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:22 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:22.958903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:22.959518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:22.966122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.966575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:22.967370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:22.967812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:23.099940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:23.100704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:23.107172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:23.107378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:23.107621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:23.108451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:23.108891 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:23.115273 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3a73fb1f-83bc-4b05-add6-19b71b01bcc6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.160223 May 31 22:39:23.115876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 317/624] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:22 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:23.236780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:23.244099 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c8e1c66c-78bd-4144-aa1a-6cec46faf8ef tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.148469 May 31 22:39:23.244662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 308/625] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:23 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:23.954936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:23.955876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:23.962406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:23.962877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:23.963633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:23.964062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:23.993332 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-17100eb3-2860-452c-957e-ff70c9fa1af6 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042283 May 31 22:39:23.993802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 318/626] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:23 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:24.141997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:24.142610 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:24.149573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:24.150019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:24.150806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:24.151249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:24.261595 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:24.262124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:24.268527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:24.268973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:24.269747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:24.270185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:24.400298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:24.407698 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ec7e6829-a544-4ebe-9937-d9714159aaa9 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.150229 May 31 22:39:24.408269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 319/627] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:24 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:24.454850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:24.463396 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed9408dd-ad22-467e-aa2b-197bc28d8aa7 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.325298 May 31 22:39:24.463956 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 309/628] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:24 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:25.004215 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:25.005124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:25.012265 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.012721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.013749 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.014193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.042745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d66a3940-534e-4299-9ad0-d6e144d97e64 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042593 May 31 22:39:25.043326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 320/629] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:24 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:25.424937 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:25.425545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:25.432631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.433078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.433836 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.434269 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.481014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:25.481623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:25.487997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.488444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.489213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:25.489660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:25.561507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:25.568994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-950cd974-ac73-417a-a66a-fdaad37e90bf tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.147833 May 31 22:39:25.569553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 310/630] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:25 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:25.635038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:25.643119 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b183c0b-0bd1-4d97-822d-a574534ba3c3 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.165920 May 31 22:39:25.647558 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 321/631] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:25 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:26.053798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:26.054713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:26.056546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:26.061453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.063365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.063365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.063365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.091595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=8 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:26.094284 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c3f7312a-3479-458d-9058-f9a2622679e9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044726 May 31 22:39:26.094853 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 311/632] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:26 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:26.586172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:26.586731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:26.593223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.593667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.594422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.594881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.661158 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:26.661762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:26.669617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.670069 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.671058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:26.671293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:26.725121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:26.727586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:26.734538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ed1990ed-453c-4c36-bea5-2330cb0fcea7 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.152731 May 31 22:39:26.739592 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 322/633] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:26 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:26.817431 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:26.826403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-541379c1-e6a3-4488-aa15-d5fbc0dd7b4a tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.169322 May 31 22:39:26.827106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 312/634] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:26 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:27.105945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:27.107025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:27.116252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.116700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.117515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.117951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.149529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8841e84e-617d-479a-9e9e-eb3bafc422e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047505 May 31 22:39:27.150086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 323/635] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:27 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:27.309558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:27.310597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:27.316723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.317179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.317956 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.318400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.341578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'flavor' on Instance uuid 9722d9d2-d3d8-4015-9c90-6c61603f8728 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:27.685172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed061865-8762-4c8b-873d-4d930e24c00a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/action" status: 200 len: 32 microversion: 2.1 time: 0.379329 May 31 22:39:27.686196 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 313/636] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:39:27 2022] POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/action => generated 32 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:39:27.695844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:27.696447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:27.704864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.705309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.706265 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.706694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.752043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:27.752789 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:27.759265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.759705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.760474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.760903 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.839761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:27.848083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1cd6caef-be69-4503-ab0f-d24ee459d004 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.156477 May 31 22:39:27.848726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 324/637] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:27 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:27.854927 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:27.856018 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:27.862579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.863071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.863847 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:27.864286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:27.978442 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:27.986799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b2cd16cd-3e1b-41ae-a6dc-f08ef90d8ada tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.238818 May 31 22:39:27.987394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 314/638] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:27 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:28.010407 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:28.018199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0bc29313-d076-4e13-8823-fe7c1b6b2080 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.167030 May 31 22:39:28.018764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 325/639] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:27 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:28.161048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:28.162024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:28.170710 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.171702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.172485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.172918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.206247 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-21b47568-8343-467c-a537-0112dd2fbacd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049036 May 31 22:39:28.206711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 315/640] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:39:28 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:39:28.267449 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:28.267945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:28.274585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.275066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.275820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.276332 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.301114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:39:28.611610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8674b5f1-f2f0-4f16-9f1d-8d3fc419c7e5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 204 len: 0 microversion: 2.1 time: 0.347802 May 31 22:39:28.612373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 326/641] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:39:28 2022] DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:39:28.621018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:28.621802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:28.627912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.628356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.629148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.629744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.760576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:28.768052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-945bf765-fb2a-40df-b070-79c87a77c29b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1681 microversion: 2.1 time: 0.150927 May 31 22:39:28.768602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 316/642] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:28 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:28.866503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:28.867241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:28.873565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.874010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:28.874762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:28.875214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.002633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:29.003748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:29.004494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:29.010995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.011133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a0e90e02-e882-4522-bbc4-f3071c60ecb1 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.149292 May 31 22:39:29.011442 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.016474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 327/643] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:28 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:29.016619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.016619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.036422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:29.037030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:29.044857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.045307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.046083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.046521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.154858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:29.163286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8b8a525d-e68d-4d8e-8d4b-7148154b48ea tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.162909 May 31 22:39:29.163846 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 317/644] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:28 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:29.168248 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-fbf50261-cae2-42ee-9cdc-68e113367d3e req-d56b9083-798c-464d-bec3-2757b506b7eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6581fa26-a8f9-42ad-997e-3bd39af691fe", "name": "network-vif-plugged", "status": "completed", "tag": "ad9145cf-3ff8-46da-949c-775b67c0f4d6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:29.177518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fbf50261-cae2-42ee-9cdc-68e113367d3e req-d56b9083-798c-464d-bec3-2757b506b7eb service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.178078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-fbf50261-cae2-42ee-9cdc-68e113367d3e req-d56b9083-798c-464d-bec3-2757b506b7eb service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.191151 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-fbf50261-cae2-42ee-9cdc-68e113367d3e req-d56b9083-798c-464d-bec3-2757b506b7eb service nova] Creating event network-vif-plugged:ad9145cf-3ff8-46da-949c-775b67c0f4d6 for instance 6581fa26-a8f9-42ad-997e-3bd39af691fe on hv-cinder-84414 May 31 22:39:29.196045 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-fbf50261-cae2-42ee-9cdc-68e113367d3e req-d56b9083-798c-464d-bec3-2757b506b7eb service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031040 May 31 22:39:29.196823 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 318/645] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:29.202798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:29.211195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-44807898-bbb4-40ab-a67e-7da29182e9ea tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.178857 May 31 22:39:29.211758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 328/646] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:29 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:29.786397 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:29.787115 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:29.793232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.793687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.794445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:29.794911 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:29.923851 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:29.932689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-79e6381c-2695-4054-8dd6-92050de6e2f1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1681 microversion: 2.1 time: 0.151033 May 31 22:39:29.933273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 319/647] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:29 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:30.029220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:30.029670 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:30.036103 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.036544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.037327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.037760 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.162350 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:30.170488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d82f5a02-7c1a-45d1-8425-580e0222d8f4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.145307 May 31 22:39:30.171083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 329/648] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:30 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:30.180229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:30.180827 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:30.186947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.187389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.188144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.188573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.228072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:30.228826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:30.235115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.235636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.236487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.236991 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.317174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:30.325233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9cd3d082-2276-4128-8ef5-af200281ef16 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.149319 May 31 22:39:30.325997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 320/649] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:30 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:30.382088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:30.390060 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c645508c-b870-4c48-a8dd-8fbadeb784fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.166409 May 31 22:39:30.390624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 330/650] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:30 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:30.949699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:30.950316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:30.956810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.957473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:30.958249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:30.958688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.187737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:31.188371 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:31.195449 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.195965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.204657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.204657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.204903 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:31.213979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1be39219-cda0-406e-9d99-2ed2545790ba tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1681 microversion: 2.1 time: 0.268048 May 31 22:39:31.214774 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 321/651] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:30 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1681 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:31.343254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:31.346070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:31.351278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.351731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.352572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.352999 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.361508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:31.370557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d96cee32-e15d-4ffb-85dc-846e6bbb696b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.186641 May 31 22:39:31.371477 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 331/652] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:31 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:31.371658 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:31.407124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:31.407738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:31.414479 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.414968 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.415746 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:31.416258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:31.567898 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:31.576191 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e7ef18d3-e7e7-464a-b3c4-4beff583747c tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.172896 May 31 22:39:31.576792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 332/653] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:31 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:31.801990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:31.808588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f3fb7cd-4d0c-4aa7-aa1f-9657bc1c1868 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.470760 May 31 22:39:31.809403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 322/654] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:31 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:32.017740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-d5acefd8-922e-469b-91e9-deedb4ce3dc0 req-a0996c7e-a853-4523-80cb-fce2200f6c93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c60508e7-6ac1-4814-99ee-6e8d1d4e2057", "name": "network-vif-deleted", "tag": "c597d8de-7087-4446-90e2-a5e14a1cda66"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:32.026347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d5acefd8-922e-469b-91e9-deedb4ce3dc0 req-a0996c7e-a853-4523-80cb-fce2200f6c93 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.032762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d5acefd8-922e-469b-91e9-deedb4ce3dc0 req-a0996c7e-a853-4523-80cb-fce2200f6c93 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.038460 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-d5acefd8-922e-469b-91e9-deedb4ce3dc0 req-a0996c7e-a853-4523-80cb-fce2200f6c93 service nova] Creating event network-vif-deleted:c597d8de-7087-4446-90e2-a5e14a1cda66 for instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 on hv-cinder-84414 May 31 22:39:32.044115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-d5acefd8-922e-469b-91e9-deedb4ce3dc0 req-a0996c7e-a853-4523-80cb-fce2200f6c93 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030528 May 31 22:39:32.044715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 333/655] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:32.231761 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:32.232374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:32.238844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.239290 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.240058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.240496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.315950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:32.325001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1c734f73-966d-4b1d-b8e2-9748d3cbca10 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1613 microversion: 2.1 time: 0.097021 May 31 22:39:32.325807 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 323/656] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:32 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1613 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:32.390771 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:32.391673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:32.398947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.399403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.402667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.402667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.559940 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:32.568601 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eded0721-ef41-43f0-92cb-cf52889c61a8 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.182963 May 31 22:39:32.580549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 334/657] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:32 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:32.593663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:32.600136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:32.600706 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.601160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.602137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.602578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.745508 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:32.753996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8d611ee6-3262-4d9c-8738-2a70a8e04025 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.164294 May 31 22:39:32.754643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 324/658] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:32 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:32.825407 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:32.826008 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:32.832043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.832483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.833234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:32.833669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:32.970638 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:32.978654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2f115b1b-99d1-4cbb-b41e-c49163ba0aa1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1319 microversion: 2.1 time: 0.157168 May 31 22:39:32.980990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 335/659] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:32 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:33.341729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:33.342494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:33.345130 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:33.349981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.350464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.351281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.351725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.385857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.385857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.385857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'fault' on Instance uuid c60508e7-6ac1-4814-99ee-6e8d1d4e2057 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:33.431263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:33.438657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-855131e5-37ad-4df8-b0e7-e0939d0f7147 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 200 len: 1331 microversion: 2.1 time: 0.101046 May 31 22:39:33.439247 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 325/660] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:33 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:33.586348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:33.587023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:33.593465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.593913 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.594683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.595152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.719856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:33.728212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8714a5ea-37ba-4413-bd78-3545c619af2d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.145755 May 31 22:39:33.728773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 336/661] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:33 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:33.771626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:33.773742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:33.780688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.781267 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.782154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:33.782696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:33.996903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:33.997508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:34.000355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:34.006420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.006839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.007603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.008034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.013574 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-73d51abc-bd79-483a-ab99-2bae51fba14b tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.246365 May 31 22:39:34.014639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 326/662] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:33 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:34.154094 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:34.161564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f0689cdd-16ec-43c4-aae7-715fc7f9a13a tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1507 microversion: 2.1 time: 0.169367 May 31 22:39:34.162129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 337/663] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:33 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:34.185331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "072cc1cd-c84a-4f40-ba14-a3134a8f89b1", "device": "/dev/sdb"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:34.186971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:34.192964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.193419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.194692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.195156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.456002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:34.456617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:34.463838 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.464510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.465465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.465912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.480204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 HTTP/1.1 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:39:34.481840 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:39:34.483521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'c60508e7-6ac1-4814-99ee-6e8d1d4e2057'} May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:39:34.484510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:39:34.485995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:39:34.487317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:39:34.487317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc9a9002-b007-4c4c-aeb7-ef43147e63e2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 404 len: 111 microversion: 2.1 time: 0.031436 May 31 22:39:34.487317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 338/664] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:34 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:39:34.491981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a1da5658-c64c-454e-9d09-f75fc89b06cc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '.version_select at 0x7ff45e2f2160>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:34.583588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a1da5658-c64c-454e-9d09-f75fc89b06cc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071083904" status: 202 len: 0 microversion: 2.1 time: 0.095131 May 31 22:39:34.584160 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 339/665] 10.222.0.39 () {58 vars in 1220 bytes} [Tue May 31 22:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1071083904 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:34.746293 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:34.746960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:34.753859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.754466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.755157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:34.755670 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:34.759043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:34.904688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:34.913554 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1299d65a-60d4-426a-a7b3-4b7493dd0652 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.171874 May 31 22:39:34.914337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 340/666] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:34 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:34.941422 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-43a07069-b4af-4c4a-949e-be7e384fac70 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "POST /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.759855 May 31 22:39:34.948607 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 327/667] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:39:34 2022] POST /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe/os-volume_attachments => generated 194 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:35.031582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:35.032275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:35.040291 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:35.040750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:35.041526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:35.042134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:35.195845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:35.204209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1ef04143-8906-4264-afdd-8258ee0a2efe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.177081 May 31 22:39:35.204796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 341/668] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:35 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:35.346771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-86f5d0c6-fa1d-4782-a362-96d475945add tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: .version_select at 0x7ff45db50ca0>, body: {"keypair": {"name": "tempest-keypair-762140760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcr7mDkU7sTxlpkFv0onVaIuYko/Hvm/SpkPtFWOAMpAP7zQmISPCht+L436cucmIGdmPFz5FgayXteBBhv/Z+rEQ0BBp0T72Vn/Hhkcb3FtmEaI2JMgSGJERYYyBq7ZQ=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:35.360653 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-86f5d0c6-fa1d-4782-a362-96d475945add tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:39:35.364451 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-86f5d0c6-fa1d-4782-a362-96d475945add tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:39:35.438850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-86f5d0c6-fa1d-4782-a362-96d475945add tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.096254 May 31 22:39:35.439385 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 328/669] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:39:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:35.937906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:35.937906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:35.939203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:35.939654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:35.940408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:35.940843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:36.072658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:36.080935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3ad12f4a-ba41-406b-9369-1a94fdd76566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.154059 May 31 22:39:36.081505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 342/670] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:35 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:36.221806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:36.222586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:36.229479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:36.233157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:36.233157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:36.233157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:36.404195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:36.412152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff3dbf91-e975-4822-8a53-d299cb2c78fd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1755 microversion: 2.1 time: 0.194382 May 31 22:39:36.421189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 329/671] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:36 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:37.100196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:37.100912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:37.105287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:37.117004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:37.117562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:37.118529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:37.119137 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:37.251345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:37.259262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-06c3384d-fc17-42ca-ad63-e9d87d755fa9 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.163584 May 31 22:39:37.259828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 343/672] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:37 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:37.430214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:37.430872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:37.437155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:37.437607 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:37.438378 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:37.438840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:37.663883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:37.671820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0704472c-705b-4fe1-8caf-9769e421c15e tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1758 microversion: 2.1 time: 0.246035 May 31 22:39:37.672392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 330/673] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:37 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1758 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:37.862986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1206598323", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a18a0f-17f5-48fc-adf9-abe14bc8b4bd"}], "security_groups": [{"name": "tempest-securitygroup--2082463085"}], "key_name": "tempest-keypair-762140760", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:37.961592 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] validate_networks() for [('10a18a0f-17f5-48fc-adf9-abe14bc8b4bd', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:39:38.277817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:38.278587 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:38.285427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:38.285922 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:38.286707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:38.287165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:38.423238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:38.432311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7233ff38-d6c2-4220-a9db-af708187f12b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.158871 May 31 22:39:38.432956 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 331/674] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:38 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:38.531930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:39:38.532385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:39:38.532843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:39:38.533252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:39:38.533663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:39:38.542643 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:38.543118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:38.543915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:38.544362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:38.609786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:39:38.613765 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:39:38.625116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:39:38.627391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:39:38.773729 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ad50bafe-7e7d-46bf-8188-1715110118a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.915054 May 31 22:39:38.774381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 344/675] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:39:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 916 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:39:38.784475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fb0ca4c4-86da-4b09-a5c0-0cda9cd79875 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:38.785450 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fb0ca4c4-86da-4b09-a5c0-0cda9cd79875 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:38.839025 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fb0ca4c4-86da-4b09-a5c0-0cda9cd79875 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:38.845986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fb0ca4c4-86da-4b09-a5c0-0cda9cd79875 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1241 microversion: 2.1 time: 0.065264 May 31 22:39:38.846582 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 332/676] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:38 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:39.449833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:39.450438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:39.457125 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:39.457567 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:39.458322 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:39.458756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:39.588616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:39.597617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8fbb3d91-4d34-40bf-accf-c08e415347bc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.151693 May 31 22:39:39.598196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 345/677] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:39 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:39.863374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:39.863983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:39.872172 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:39.872621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:39.873386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:39.873821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:39.934465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:39.941842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f7143164-8acb-49c9-ac25-b2e597a8032a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1237 microversion: 2.1 time: 0.082338 May 31 22:39:39.942394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 333/678] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:39 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1237 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:40.614620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:40.615507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:40.622220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:40.622663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:40.623487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:40.623919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:40.764982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:40.773697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d91e7119-8f79-4850-ad29-08c9c3885340 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.163011 May 31 22:39:40.775218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 346/679] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:40 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:40.959408 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:40.960120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:40.967532 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:40.973250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:40.973250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:40.973250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:41.044540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:41.052155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-df6697bf-650b-4ff7-91e2-b347e4222996 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1299 microversion: 2.1 time: 0.096627 May 31 22:39:41.058961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 334/680] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:40 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1299 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:41.790760 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:41.792348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:41.798588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:41.802496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:41.802496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:41.802496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:41.927090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:41.935898 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3f49a062-b98b-4d00-82d0-3d77d84a08bb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.149497 May 31 22:39:41.936462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 347/681] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:41 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:42.070576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:42.071313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:42.085070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:42.085988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:42.086865 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:42.087507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:42.283240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:42.292102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-93f6abc1-a071-4391-a3eb-24f9b4e906a3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.226522 May 31 22:39:42.293209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 335/682] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:42 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:42.404655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-083b38c5-28fa-496d-a073-4e30b888f6e9 req-60c5c4a7-3eb8-4d06-b5cf-9b1849c8d5ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045c3d9d-a2aa-4c66-8236-724814eddc25", "tag": "3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:42.419276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-083b38c5-28fa-496d-a073-4e30b888f6e9 req-60c5c4a7-3eb8-4d06-b5cf-9b1849c8d5ca service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:42.419731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-083b38c5-28fa-496d-a073-4e30b888f6e9 req-60c5c4a7-3eb8-4d06-b5cf-9b1849c8d5ca service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:42.434012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-083b38c5-28fa-496d-a073-4e30b888f6e9 req-60c5c4a7-3eb8-4d06-b5cf-9b1849c8d5ca service nova] Creating event network-changed:3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1 for instance 045c3d9d-a2aa-4c66-8236-724814eddc25 on hv-cinder-84414 May 31 22:39:42.438542 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-083b38c5-28fa-496d-a073-4e30b888f6e9 req-60c5c4a7-3eb8-4d06-b5cf-9b1849c8d5ca service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037937 May 31 22:39:42.439355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 348/683] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:42.952920 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:42.953559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:42.960481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:42.960780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:42.961877 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:42.962393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:43.309884 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:43.310505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:43.317574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:43.318025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:43.318838 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:43.319281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:43.393821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:43.404763 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-df17bd64-1aab-46c6-a17a-f3620e466eee tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.455791 May 31 22:39:43.405344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 336/684] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:42 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:43.455620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:43.464978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2fc96998-e962-4ee3-9a0a-5b3881e32f76 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.159438 May 31 22:39:43.466551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 349/685] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:43 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:44.422943 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:44.423560 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:44.430867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:44.431335 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:44.432104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:44.432551 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:44.481295 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:44.481902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:44.488519 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:44.488960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:44.489720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:44.490156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:44.564039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:44.572754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7ce32956-5442-4d1c-b201-194287d7a3f0 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.153757 May 31 22:39:44.573326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 337/686] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:44 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:44.616723 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:44.623967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2855d3a6-7956-49e1-861f-9ea1b376a5c8 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.146511 May 31 22:39:44.624521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 350/687] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:44 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:45.590191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:45.590812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:45.597366 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:45.597810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:45.598561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:45.599017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:45.641171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:45.641812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:45.648843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:45.649291 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:45.650056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:45.650491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:45.728398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:45.743246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9e5cb91f-ad26-4c06-b4df-5330ab1f1566 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.150206 May 31 22:39:45.743246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 338/688] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:45 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:45.781258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:45.788641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fa537fd2-3c98-413e-933d-3442d7415667 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.151330 May 31 22:39:45.789202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 351/689] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:45 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:46.753446 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:46.754068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:46.760859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:46.762601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:46.762601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:46.762601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:46.780979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:46.806189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:46.807106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:46.813903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:46.814355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:46.824467 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:46.824467 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:46.894699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:46.903316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9a399710-fab6-4140-845d-eb714087427e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.153666 May 31 22:39:46.903873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 339/690] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:46 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:46.945197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:46.952870 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-85b1a27f-47f0-49c8-90dd-69ba99596cc4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.151653 May 31 22:39:46.953426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 352/691] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:46 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:47.921202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:47.921812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:47.928862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:47.929316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:47.930082 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:47.930518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:47.969284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:47.970203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:47.977408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:47.977852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:47.978616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:47.979077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:48.076656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:48.085133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6aa59a2d-f982-4432-bc1c-6d46a2a7b014 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.168112 May 31 22:39:48.098847 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 340/692] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:47 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:48.114547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:48.121931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-61baa6f7-eacd-444b-936a-d2bb07a89fcb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.156456 May 31 22:39:48.122642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 353/693] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:47 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:49.114593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:49.115748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:49.117581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:49.122823 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:49.125188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:49.125188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:49.125188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:49.138809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:49.139430 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:49.141364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:49.142017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:49.147372 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:49.147821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:49.148592 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:49.149030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:49.256882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:49.262462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4259854d-3de7-426a-9a99-9046698e03ac tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.151689 May 31 22:39:49.263068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 341/694] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:49 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:49.285674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:49.285978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b84b8875-c0de-4984-a1d3-1d070b0554ae tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.150966 May 31 22:39:49.286546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 354/695] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:49 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:50.279502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:50.280112 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:50.286611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:50.287068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:50.287886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:50.288374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:50.304088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:50.304688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:50.310656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:50.311127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:50.311883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:50.312312 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:50.420868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:50.429595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6e1cdb24-7c90-4844-929e-8e777f5cb14e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.153944 May 31 22:39:50.439108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 342/696] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:50 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:50.440021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:50.447044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-22c01c27-3d76-4e12-8396-da5d2ce91f7b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.147563 May 31 22:39:50.447791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 355/697] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:50 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:51.446588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:51.447218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:51.453635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:51.454079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:51.454854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:51.455291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:51.463644 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:51.464260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:51.470669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:51.471142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:51.471914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:51.472351 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:51.584823 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:51.592859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6c96edfc-f308-4c95-b9b6-eb1496b6e689 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.150121 May 31 22:39:51.593439 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 343/698] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:51 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:51.605701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:51.613046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d83849eb-2cfd-4dea-9670-c3b4278a21b4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.153133 May 31 22:39:51.613610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 356/699] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:51 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:52.612852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:52.612852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:52.618313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:52.618817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:52.619634 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:52.620166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:52.630636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:52.631368 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:52.639928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:52.640448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:52.641315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:52.641829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:52.759091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:52.767300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c039f87-9d8a-4168-8bab-7597651e8e15 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.160897 May 31 22:39:52.767880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 344/700] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:52 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:52.773228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:52.780758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-141ff89e-6e23-461e-a278-dcc49e47564d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.153943 May 31 22:39:52.782128 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 357/701] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:52 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:53.784867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:53.786616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:53.796745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:53.797799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:53.798473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:53.798960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:53.799385 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:53.799880 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:53.813929 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:53.814685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:53.815554 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:53.815999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:53.819406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:39:53.937320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:53.945576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-de1881a5-c115-4f61-bd4c-d9d4e65f0f80 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1736 microversion: 2.1 time: 0.164451 May 31 22:39:53.955750 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 345/702] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:53 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:53.961067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-da62a196-b8b9-4f3e-8728-723cba3ae574 req-bed04dd2-624d-47a4-9bdb-ed363881fe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c3d9d-a2aa-4c66-8236-724814eddc25", "name": "network-vif-plugged", "status": "completed", "tag": "3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:53.969153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-da62a196-b8b9-4f3e-8728-723cba3ae574 req-bed04dd2-624d-47a4-9bdb-ed363881fe5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:53.969823 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-da62a196-b8b9-4f3e-8728-723cba3ae574 req-bed04dd2-624d-47a4-9bdb-ed363881fe5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:53.981424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:53.982100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-da62a196-b8b9-4f3e-8728-723cba3ae574 req-bed04dd2-624d-47a4-9bdb-ed363881fe5e service nova] Creating event network-vif-plugged:3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1 for instance 045c3d9d-a2aa-4c66-8236-724814eddc25 on hv-cinder-84414 May 31 22:39:53.987707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-da62a196-b8b9-4f3e-8728-723cba3ae574 req-bed04dd2-624d-47a4-9bdb-ed363881fe5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030350 May 31 22:39:53.988828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 346/703] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:53.989809 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d24b6b26-2fae-4bd7-9108-64765ef0faed tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.196198 May 31 22:39:53.990447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 358/704] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:53 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:54.963443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:54.964155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:54.970410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:54.970824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:54.971600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:54.972044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.008640 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:55.009686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:55.016601 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.017210 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.018083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.018520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.105480 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:55.113978 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-85b3aa69-72a2-4cbc-914b-51604231b7f3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1716 microversion: 2.1 time: 0.155726 May 31 22:39:55.114652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 347/705] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:54 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1716 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:55.150897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:55.158421 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-078af319-8cca-4079-913b-8291f706413f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.154130 May 31 22:39:55.159077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 359/706] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:55 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:55.217980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:55.218472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:55.224592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.224985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.225772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.226209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.307103 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] HTTP exception thrown: Cannot 'detach_volume' instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 while it is in vm_state rescued May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Request method failure captured: May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments/ccad5c06-1034-4658-b9bb-0da6c6f1ff82 HTTP/1.1 May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEmgsIR1PKebLwbTtBv5_bGKBIdJ1FudIYqAYv6Vl-hTQfQ6sgLA1jR7riu4CBMrTlO6YycpQS0G6A7mBg-mchauL_8g5fI7qA4jCLL7etM7QnSywfyKnssNi5Q5YMi0dsrBZH_HE3JXWt4ID4o9VFrtV4yqyKJLwtFfNUYOTe2FM May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: dbc9abb548994abba42919b7d850be0b May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:39:55.308929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dbc9abb548994abba42919b7d850be0b"}]}] May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: dbc9abb548994abba42919b7d850be0b May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a5a154e334e49db92d41cefaf75ef27 May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:39:55.310517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Cannot 'detach_volume' instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 while it is in vm_state rescued May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'server_id': '9722d9d2-d3d8-4015-9c90-6c61603f8728', 'id': 'ccad5c06-1034-4658-b9bb-0da6c6f1ff82'} May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:39:55.314655 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 while it is in vm_state rescued May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 while it is in vm_state rescued May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:39:55.316126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Returning 409 to user: Cannot 'detach_volume' instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 while it is in vm_state rescued {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:39:55.317332 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e21ab912-3618-4083-8595-62190b4d7658 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments/ccad5c06-1034-4658-b9bb-0da6c6f1ff82" status: 409 len: 152 microversion: 2.1 time: 0.096487 May 31 22:39:55.317332 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 348/707] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:39:55 2022] DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments/ccad5c06-1034-4658-b9bb-0da6c6f1ff82 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 31 22:39:55.320062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:55.320632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:55.326564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.327054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.327819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.328261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.545062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-596d4c61-ec60-473b-82aa-2a7827bb8b69 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/action" status: 202 len: 0 microversion: 2.1 time: 0.229197 May 31 22:39:55.545709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 360/708] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:39:55 2022] POST /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:55.555704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:55.556331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:55.562355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.562895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.563661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:55.564096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:55.723423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:55.731677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5dad6838-f4aa-430d-a51f-9611e7ddde12 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1724 microversion: 2.1 time: 0.181665 May 31 22:39:55.732238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 349/709] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:55 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:56.036970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:56.037557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:56.044249 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.044731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.045500 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.045936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.124216 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lazy-loading 'services' on Instance uuid 6581fa26-a8f9-42ad-997e-3bd39af691fe {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:39:56.175126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:56.175747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:56.182997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.183452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.184224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.184667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.301756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-921a59ea-92d8-43a4-8968-1a1eee5c8ad1 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe/os-volume_attachments/072cc1cd-c84a-4f40-ba14-a3134a8f89b1" status: 202 len: 0 microversion: 2.1 time: 0.269338 May 31 22:39:56.302489 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 361/710] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:39:56 2022] DELETE /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe/os-volume_attachments/072cc1cd-c84a-4f40-ba14-a3134a8f89b1 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:39:56.317234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:56.325536 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3383537c-1168-4a84-8740-b8d887de502f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1367 microversion: 2.1 time: 0.154284 May 31 22:39:56.326132 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 350/711] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:56 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:39:56.756247 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:56.764928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:56.764928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.764928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.764928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:56.765314 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:56.892710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:56.900637 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41d6a868-94b6-4ba8-8ffe-c6940e3ae218 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1724 microversion: 2.1 time: 0.148543 May 31 22:39:56.901204 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 362/712] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:56 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:57.342418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:57.343054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:57.349757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.350203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:57.351684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.352128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:57.482985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:57.490333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce3b4a84-cd4d-41ae-ba8e-5728b88d90f9 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1557 microversion: 2.1 time: 0.151964 May 31 22:39:57.490912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 351/713] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:57 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1557 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:57.506326 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:57.507360 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:57.513600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.514039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:57.514799 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.515260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:57.594209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bdeb565f-f1d3-46f5-801a-93d2764e14a5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091559 May 31 22:39:57.594826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 363/714] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:39:57 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:39:57.917715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:57.918333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:57.924454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.924927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:57.925688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:57.926126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.059126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:58.067334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-726d8882-49e3-464b-a085-81a89a3657e3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1724 microversion: 2.1 time: 0.153523 May 31 22:39:58.067892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 352/715] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:57 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:58.465408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:58.465907 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:58.472059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:58.472503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.473757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:58.474311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.503051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:39:58.564499 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-17c4c70c-a81d-4e51-aae7-2520e6e309a7 req-05ee8036-4ef3-452e-a3c5-334800bd6c0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "045c3d9d-a2aa-4c66-8236-724814eddc25", "tag": "3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:39:58.573370 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-17c4c70c-a81d-4e51-aae7-2520e6e309a7 req-05ee8036-4ef3-452e-a3c5-334800bd6c0d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:58.573853 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-17c4c70c-a81d-4e51-aae7-2520e6e309a7 req-05ee8036-4ef3-452e-a3c5-334800bd6c0d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.585950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-17c4c70c-a81d-4e51-aae7-2520e6e309a7 req-05ee8036-4ef3-452e-a3c5-334800bd6c0d service nova] Creating event network-changed:3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1 for instance 045c3d9d-a2aa-4c66-8236-724814eddc25 on hv-cinder-84414 May 31 22:39:58.591241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-17c4c70c-a81d-4e51-aae7-2520e6e309a7 req-05ee8036-4ef3-452e-a3c5-334800bd6c0d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030634 May 31 22:39:58.591828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 353/716] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:39:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:39:58.765394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0abc3d86-3743-48b5-91c0-371a56d237c4 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "DELETE /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 204 len: 0 microversion: 2.1 time: 0.303518 May 31 22:39:58.766078 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 364/717] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:39:58 2022] DELETE /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:39:58.775146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:58.776038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:58.782352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:58.782811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.783640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:58.784077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:58.913690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:58.921737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d50d125b-f9d5-4ae6-9ece-aa8156c7ca8f tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1559 microversion: 2.1 time: 0.151290 May 31 22:39:58.922297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 354/718] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:58 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:59.086357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:59.087079 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:59.093171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:59.093691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:59.094567 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:59.095035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:59.235281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:39:59.245538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-726ea82f-220f-4734-b100-3dc75c546c1b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1724 microversion: 2.1 time: 0.163543 May 31 22:39:59.246047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 365/719] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:59 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:39:59.938442 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:39:59.938996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:39:59.945747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:59.946200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:39:59.947010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:39:59.947475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:00.075772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:00.083119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-89e12527-ab46-4c2f-a551-327039e5ed11 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1513 microversion: 2.1 time: 0.148660 May 31 22:40:00.083676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 355/720] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:39:59 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:00.262773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:00.263396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:00.269978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:00.270419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:00.271358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:00.271792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:00.395976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:00.404478 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8055e59e-9584-42d6-8d68-73dfd8b3e304 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1724 microversion: 2.1 time: 0.145599 May 31 22:40:00.405033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 366/721] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:00 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:01.100164 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:01.100824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:01.107314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.107764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.108539 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.108985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.245628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:01.254086 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-97188819-cefc-482c-ab52-9dc6cebb2fdd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1513 microversion: 2.1 time: 0.157757 May 31 22:40:01.254762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 356/722] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:01 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:01.421514 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:01.422127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:01.429543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.429996 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.430762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.431228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.557770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:01.565549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e16f4115-df12-4466-9357-8eb0585c364c tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1730 microversion: 2.1 time: 0.147934 May 31 22:40:01.566154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 367/723] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:01 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1730 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:01.581686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:01.582184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:01.588820 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.589282 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.590047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:01.590488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:01.607205 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:01.669969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3fdf2e3e-9e88-429c-b21a-d65e80cb0cae tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092071 May 31 22:40:01.670933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 357/724] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:40:01 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:02.275619 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:02.275619 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:02.278812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:02.279369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:02.280219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:02.280719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:02.461976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:02.469835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-07aa537c-1ebb-4ac1-be72-304d5747787d tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1513 microversion: 2.1 time: 0.202065 May 31 22:40:02.470424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 368/725] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:02 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1513 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:02.706383 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-9a5c4b7f-dbd0-4457-a8ed-1b71b5d11fc7 req-aa59e7fa-a518-479d-b813-2742094a115c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6581fa26-a8f9-42ad-997e-3bd39af691fe", "name": "network-vif-deleted", "tag": "ad9145cf-3ff8-46da-949c-775b67c0f4d6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:02.716024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9a5c4b7f-dbd0-4457-a8ed-1b71b5d11fc7 req-aa59e7fa-a518-479d-b813-2742094a115c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:02.716557 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9a5c4b7f-dbd0-4457-a8ed-1b71b5d11fc7 req-aa59e7fa-a518-479d-b813-2742094a115c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:02.730190 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-9a5c4b7f-dbd0-4457-a8ed-1b71b5d11fc7 req-aa59e7fa-a518-479d-b813-2742094a115c service nova] Creating event network-vif-deleted:ad9145cf-3ff8-46da-949c-775b67c0f4d6 for instance 6581fa26-a8f9-42ad-997e-3bd39af691fe on hv-cinder-84414 May 31 22:40:02.735753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-9a5c4b7f-dbd0-4457-a8ed-1b71b5d11fc7 req-aa59e7fa-a518-479d-b813-2742094a115c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033672 May 31 22:40:02.736581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 358/726] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:02.801327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-99e6b89e-11a9-4fcd-8230-82768797fd5e req-a334fb68-95a9-409a-8416-890fb19e0d8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:02.816949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-99e6b89e-11a9-4fcd-8230-82768797fd5e req-a334fb68-95a9-409a-8416-890fb19e0d8f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:02.817770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-99e6b89e-11a9-4fcd-8230-82768797fd5e req-a334fb68-95a9-409a-8416-890fb19e0d8f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:02.829320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-99e6b89e-11a9-4fcd-8230-82768797fd5e req-a334fb68-95a9-409a-8416-890fb19e0d8f service nova] Creating event network-changed:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:40:02.834231 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-99e6b89e-11a9-4fcd-8230-82768797fd5e req-a334fb68-95a9-409a-8416-890fb19e0d8f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036805 May 31 22:40:02.834816 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 369/727] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:03.490351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:03.493592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:03.498290 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:03.499012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:03.500276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:03.500872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:03.537743 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:03.538466 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:03.539109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lazy-loading 'fault' on Instance uuid 6581fa26-a8f9-42ad-997e-3bd39af691fe {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:03.584020 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aec2e49221754396968ec5df0f53525f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b4d8319cf5c4c9299d8e212e286df6a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:03.592646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3c738e87-f1d1-4381-8b71-f228d86fcc71 tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 200 len: 1309 microversion: 2.1 time: 0.108405 May 31 22:40:03.593730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 359/728] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:03 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:04.611018 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:04.611707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] [instance: 6581fa26-a8f9-42ad-997e-3bd39af691fe] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:04.617900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:04.618343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:04.619120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:04.619553 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:04.632364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] HTTP exception thrown: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Request method failure captured: May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe HTTP/1.1 May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpiJBdq2jZW2_PRzR40j2PZ4IaPDI1s-7KXvRnkT1t6sxapjpQLiHE-O5oHW3-6iqBUYX-9ALy2ZLZ4hNQkWfEpPVY9ak8xyzufdiyJk934V8qC2_iVNJQSMnhWero4CDTeYQ_RBWgNaWbQt3yOqV5SyZy14kSliMD-uoZ0rWGA5ugI May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 7b4d8319cf5c4c9299d8e212e286df6a May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:40:04.633951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/7b4d8319cf5c4c9299d8e212e286df6a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_7b4d8319cf5c4c9299d8e212e286df6a"}]}] May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 7b4d8319cf5c4c9299d8e212e286df6a May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1223377603 May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesSnapshotTestJSON-1223377603-project May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: aec2e49221754396968ec5df0f53525f May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesSnapshotTestJSON-1223377603-project May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. May 31 22:40:04.635606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '6581fa26-a8f9-42ad-997e-3bd39af691fe'} May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:04.636611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. May 31 22:40:04.638096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:04.639830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] Returning 404 to user: Instance 6581fa26-a8f9-42ad-997e-3bd39af691fe could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:04.639830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c8cabae7-6607-4a18-bb9f-fd9125eabddd tempest-VolumesSnapshotTestJSON-1223377603 tempest-VolumesSnapshotTestJSON-1223377603-project] 10.222.0.39 "GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe" status: 404 len: 111 microversion: 2.1 time: 0.029061 May 31 22:40:04.639830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 370/729] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:04 2022] GET /compute/v2.1/servers/6581fa26-a8f9-42ad-997e-3bd39af691fe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:40:04.848660 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-17768a4a-35c1-40b9-b1eb-677cb68e0783 req-4a23dfc8-33ea-4a65-b597-656b7a41b51e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:04.853355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:04.858619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-17768a4a-35c1-40b9-b1eb-677cb68e0783 req-4a23dfc8-33ea-4a65-b597-656b7a41b51e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:04.859101 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-17768a4a-35c1-40b9-b1eb-677cb68e0783 req-4a23dfc8-33ea-4a65-b597-656b7a41b51e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:04.870127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-17768a4a-35c1-40b9-b1eb-677cb68e0783 req-4a23dfc8-33ea-4a65-b597-656b7a41b51e service nova] Creating event network-changed:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:40:04.874926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-17768a4a-35c1-40b9-b1eb-677cb68e0783 req-4a23dfc8-33ea-4a65-b597-656b7a41b51e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029932 May 31 22:40:04.875504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 360/730] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:09.870530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:09.871117 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:09.878405 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:09.878798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:09.879268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:09.880035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:09.880476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:09.909827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f4781a6b-b7fb-4086-a0a6-1c300cd2cc51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments/8c59b88e-899f-475c-a112-ac445687193d" status: 200 len: 194 microversion: 2.20 time: 0.043391 May 31 22:40:09.910402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 371/731] 10.222.0.39 () {60 vars in 1453 bytes} [Tue May 31 22:40:09 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments/8c59b88e-899f-475c-a112-ac445687193d => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:40:09.974054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:09.976047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:09.981959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:09.982405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:09.983199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:09.983629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:10.064904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'services' on Instance uuid 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:10.299305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fbeb0dcc-d622-46ed-b41a-793fda6ffc7e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments/8c59b88e-899f-475c-a112-ac445687193d" status: 202 len: 0 microversion: 2.20 time: 0.330565 May 31 22:40:10.299899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 361/732] 10.222.0.39 () {60 vars in 1456 bytes} [Tue May 31 22:40:09 2022] DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments/8c59b88e-899f-475c-a112-ac445687193d => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 22:40:10.309828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:10.314696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:10.317054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:10.317503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:10.318275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:10.318718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:10.348692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-71b1fc49-9e2b-4e33-8ddc-0db2420c4416 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043323 May 31 22:40:10.349221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 372/733] 10.222.0.39 () {60 vars in 1342 bytes} [Tue May 31 22:40:10 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:40:11.361630 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:11.362877 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:11.370106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:11.370546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:11.371329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:11.371762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:11.400720 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c7ef211e-51c0-4d27-bcc0-ef86ad6b07a3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043292 May 31 22:40:11.401196 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 362/734] 10.222.0.39 () {60 vars in 1342 bytes} [Tue May 31 22:40:11 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 31 22:40:12.412442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:12.413345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:12.419939 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.420390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.421138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.421570 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.423978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:12.450742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-102c3550-917e-4983-ade7-424ecfd8a6e0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042569 May 31 22:40:12.452295 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 373/735] 10.222.0.39 () {60 vars in 1342 bytes} [Tue May 31 22:40:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:12.506997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:12.507528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:12.514409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.514897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.515664 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.516100 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.542329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:40:12.826004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ebfe0a38-894f-44ce-aa27-7e601166c3de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 204 len: 0 microversion: 2.20 time: 0.322570 May 31 22:40:12.826633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 363/736] 10.222.0.39 () {60 vars in 1279 bytes} [Tue May 31 22:40:12 2022] DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 22:40:12.835972 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:12.837417 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:12.843539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.844082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.844845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:12.845276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:12.975188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:12.983119 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:12.984651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:12.985899 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4745ace7-11a6-4456-a8cf-d0dec2592ccc tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.154746 May 31 22:40:12.986462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 374/737] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:12 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:14.005983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:14.006677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:14.013401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:14.013848 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:14.014606 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:14.015124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:14.150061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:14.158520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:14.162755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:14.162755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-17229a24-6b0d-4456-a2b0-6b47d49ae21f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.159572 May 31 22:40:14.162755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 364/738] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:14 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:15.180160 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:15.180802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:15.191089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:15.192588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:15.193396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:15.193842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:15.396462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:15.405087 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:15.406611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:15.407791 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-788dc425-42ab-45c9-9c62-cc9f17823744 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1723 microversion: 2.20 time: 0.231842 May 31 22:40:15.408348 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 375/739] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:15 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:15.854219 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-18fc03bc-643d-4189-9699-03c850387cee req-2345e093-3df7-435a-b59c-91b1ba21a394 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ae243cf-4ef7-4ec0-8650-54f44d6a84bb", "name": "network-vif-deleted", "tag": "6876e6e6-8d69-46ab-b5f9-3259ebb8205d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:15.862855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-18fc03bc-643d-4189-9699-03c850387cee req-2345e093-3df7-435a-b59c-91b1ba21a394 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:15.865136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-18fc03bc-643d-4189-9699-03c850387cee req-2345e093-3df7-435a-b59c-91b1ba21a394 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:15.875143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-18fc03bc-643d-4189-9699-03c850387cee req-2345e093-3df7-435a-b59c-91b1ba21a394 service nova] Creating event network-vif-deleted:6876e6e6-8d69-46ab-b5f9-3259ebb8205d for instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb on hv-cinder-84414 May 31 22:40:15.880271 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-18fc03bc-643d-4189-9699-03c850387cee req-2345e093-3df7-435a-b59c-91b1ba21a394 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030743 May 31 22:40:15.881104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 365/740] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:16.425595 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:16.426355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:16.433643 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:16.434094 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:16.434879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:16.435316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:16.466218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:16.466667 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:16.467165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'fault' on Instance uuid 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:16.509238 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:16.517509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:16.519040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:16.520194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f70d4507-9e5d-4d20-94e8-da64d98f073b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1371 microversion: 2.20 time: 0.098691 May 31 22:40:16.520747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 376/741] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:16 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1371 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:17.539470 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:17.540216 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:17.546939 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:17.547395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:17.548170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:17.548612 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:17.579574 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:17.580030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:17.580483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'fault' on Instance uuid 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:17.621445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:17.629320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:17.630879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:17.632034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0dc487fa-6d36-4d5e-9c27-e4c686c6d9d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1371 microversion: 2.20 time: 0.096951 May 31 22:40:17.632599 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 366/742] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:17 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:18.650951 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:18.651588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:18.658030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:18.658474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:18.659258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:18.659687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:18.688894 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:18.689342 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:18.689781 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'fault' on Instance uuid 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:18.732549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:18.740413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:18.741910 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:18.743632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7e385e42-6c67-4377-a80a-73c9184fad11 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 200 len: 1371 microversion: 2.20 time: 0.097184 May 31 22:40:18.744178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 377/743] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:18 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 1371 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:19.761465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:19.762647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:19.769195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:19.769648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:19.770431 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:19.770935 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:19.784844 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb HTTP/1.1 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:40:19.786517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:40:19.788170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '4ae243cf-4ef7-4ec0-8650-54f44d6a84bb'} May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:19.788991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:40:19.790765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:19.791880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:19.791880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-326f5dfe-81fc-4e58-ac01-4f0d4e00b9eb tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 404 len: 111 microversion: 2.20 time: 0.030644 May 31 22:40:19.791880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 367/744] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:19 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:40:19.797307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cccbc669-ed17-4082-8a81-3e7cf539a32c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '.version_select at 0x7ff45e29d790>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:19.891293 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cccbc669-ed17-4082-8a81-3e7cf539a32c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237008043" status: 204 len: 0 microversion: 2.20 time: 0.097645 May 31 22:40:19.892003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 378/745] 10.222.0.39 () {60 vars in 1258 bytes} [Tue May 31 22:40:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237008043 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 22:40:20.675055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e6a2180-0a56-4ba3-9d7b-2e0bde3fc927 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: .version_select at 0x7ff45dac6280>, body: {"keypair": {"name": "tempest-keypair-143137891", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK5jtuyW+13NIfDCImIBwTaGnw3Y0pjr6vo93cpc5yYhJohEA9yyUT8cADVeKurbI2TrgghPMwnMQ47nCuCD4hELqkAb+Wfop4YcgXqVgmGaZSyVX4riCfmrZjOeuV4p3g=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:20.689562 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-3e6a2180-0a56-4ba3-9d7b-2e0bde3fc927 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:40:20.693267 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-3e6a2180-0a56-4ba3-9d7b-2e0bde3fc927 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for user b255effa528e4100b288994bedd3c75b and project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:40:20.806336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3e6a2180-0a56-4ba3-9d7b-2e0bde3fc927 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.135219 May 31 22:40:20.806900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 368/746] 10.222.0.39 () {62 vars in 1199 bytes} [Tue May 31 22:40:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 31 22:40:23.213202 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-283276499", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dd0e2bf1-eb31-446c-bfe2-db0358452d4e"}], "security_groups": [{"name": "tempest-securitygroup--349286740"}], "key_name": "tempest-keypair-143137891", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:23.466652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] validate_networks() for [('dd0e2bf1-eb31-446c-bfe2-db0358452d4e', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:40:23.818111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:40:23.818565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:40:23.819082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:40:23.819480 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:40:23.819893 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:40:23.830750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:23.830750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:23.830750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:23.830750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:23.846636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:40:23.850498 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Getting quotas for user b255effa528e4100b288994bedd3c75b and project 1ec5f36b5e35430da4ab94f98547a8d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:40:23.861684 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:40:23.863929 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:40:23.983395 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c0e1ee6a-018a-493e-bee9-92973b2b6415 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.775132 May 31 22:40:23.984034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 379/747] 10.222.0.39 () {62 vars in 1187 bytes} [Tue May 31 22:40:23 2022] POST /compute/v2.1/servers => generated 401 bytes in 776 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 31 22:40:23.994966 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:23.995572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:24.053887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:24.061792 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:24.063348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:24.064447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dcb7af26-e940-4e41-99c2-a7332df43d21 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1280 microversion: 2.20 time: 0.074256 May 31 22:40:24.075218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 369/748] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:23 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1280 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:40:25.083006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:25.083615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:25.090181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:25.090633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:25.091431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:25.091868 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:25.151345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:25.159507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:25.161030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:25.162121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-297b0140-6061-41b4-9acf-b260da1e0575 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1284 microversion: 2.20 time: 0.083701 May 31 22:40:25.162914 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 380/749] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:25 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1284 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:26.030852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:26.031810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:26.038238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.038684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.039490 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.039925 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.071163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ec7875d1-4f16-4769-af25-560065d52a1b tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044086 May 31 22:40:26.075541 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 370/750] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:26 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:40:26.129083 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:26.129726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:26.136970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.137418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.138194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.138632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.165722 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:40:26.182908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:26.184365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:26.193836 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.194306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.195462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.195897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.324796 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:26.335631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:26.337168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:26.338802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4dbe3cf1-d670-41d0-9980-d85de5f3af8a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1340 microversion: 2.20 time: 0.161980 May 31 22:40:26.339216 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 371/751] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:26 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1340 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:40:26.505915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-09e3fdb8-67f6-4ac4-b6f5-3b7bee1dae01 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 204 len: 0 microversion: 2.1 time: 0.380155 May 31 22:40:26.506391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 381/752] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:40:26 2022] DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:40:26.514399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:26.515024 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:26.520881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.521324 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.522135 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:26.522562 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:26.659226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:26.667255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f64047d7-f56b-4977-bf98-2cfb07513ec5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1671 microversion: 2.1 time: 0.156564 May 31 22:40:26.667920 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 372/753] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:26 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:27.359633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:27.360362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:27.366893 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:27.367347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:27.368113 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:27.368601 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:27.494559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:27.502376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:27.503936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:27.505038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aaebcbe9-a632-40e5-ad2b-1df0dc8dbdf7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.149657 May 31 22:40:27.505598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 382/754] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:27 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:27.684753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:27.685370 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:27.691916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:27.692364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:27.693132 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:27.693575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:27.831809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:27.840001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c15f2918-1fb4-4271-919e-1fdd0b2e698f tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1671 microversion: 2.1 time: 0.159149 May 31 22:40:27.840572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 373/755] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:27 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:28.523488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:28.524056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:28.530424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:28.530917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:28.531700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:28.532152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:28.721708 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:28.730256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:28.731881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:28.733130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-be079a70-14d1-4396-ae49-1b6b5b9c86fe tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.213769 May 31 22:40:28.734165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 383/756] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:28 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:28.858045 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:28.858733 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:28.865237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:28.865694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:28.866469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:28.866946 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:29.084811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:29.100117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-668e76e8-ed01-4311-81b7-e10649e80cdf tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1671 microversion: 2.1 time: 0.246499 May 31 22:40:29.103730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 374/757] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:28 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1671 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:29.449005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-9b16538a-598a-4365-8c4c-ccca798a2b1e req-90954f93-eff0-4a16-931f-3c6f79af1a7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:29.463867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9b16538a-598a-4365-8c4c-ccca798a2b1e req-90954f93-eff0-4a16-931f-3c6f79af1a7c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:29.468969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9b16538a-598a-4365-8c4c-ccca798a2b1e req-90954f93-eff0-4a16-931f-3c6f79af1a7c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:29.476356 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-9b16538a-598a-4365-8c4c-ccca798a2b1e req-90954f93-eff0-4a16-931f-3c6f79af1a7c service nova] Creating event network-changed:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:40:29.481851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-9b16538a-598a-4365-8c4c-ccca798a2b1e req-90954f93-eff0-4a16-931f-3c6f79af1a7c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040446 May 31 22:40:29.482459 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 384/758] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:29.751231 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:29.751897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:29.758246 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:29.758751 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:29.760125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:29.760569 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.001354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:30.010685 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:30.012453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:30.014167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1816794a-0d62-4507-a212-6125f5536d82 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.267091 May 31 22:40:30.026404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 375/759] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:29 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:30.037648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cbf2b2b3-95e9-4455-8feb-dfdb4c80048a req-e567dbc9-91cb-4283-ac8b-da65221ee42b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14bc3b11-0b60-4e5e-b594-f60d8c18c7bb", "name": "network-vif-deleted", "tag": "c702999e-9047-4b64-a64b-1d6bc4baeab5"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:30.055158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cbf2b2b3-95e9-4455-8feb-dfdb4c80048a req-e567dbc9-91cb-4283-ac8b-da65221ee42b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:30.055948 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cbf2b2b3-95e9-4455-8feb-dfdb4c80048a req-e567dbc9-91cb-4283-ac8b-da65221ee42b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.077861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-cbf2b2b3-95e9-4455-8feb-dfdb4c80048a req-e567dbc9-91cb-4283-ac8b-da65221ee42b service nova] Creating event network-vif-deleted:c702999e-9047-4b64-a64b-1d6bc4baeab5 for instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb on hv-cinder-84414 May 31 22:40:30.091771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1815953928"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:30.092884 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:30.099761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cbf2b2b3-95e9-4455-8feb-dfdb4c80048a req-e567dbc9-91cb-4283-ac8b-da65221ee42b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065988 May 31 22:40:30.100815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:30.101473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.101626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 385/760] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:30.104307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:30.105476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.116351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:30.118338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:30.120039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:30.127106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:30.128095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.129142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:30.129804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:30.220606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:30.237706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-13e16aa0-0b33-4f6a-9b19-326420154e97 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1604 microversion: 2.1 time: 0.123870 May 31 22:40:30.238293 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 386/761] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:30 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1604 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:30.287909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.network.security_group_api [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Removing security group cf34fcd8-632a-443b-8e0b-51342ed8510d from port dd4dada1-fee7-4496-8e97-d81ad342e789 May 31 22:40:30.974067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b4e9f0d1-1278-4bdf-b771-46efa3e11757 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action" status: 202 len: 0 microversion: 2.1 time: 0.886907 May 31 22:40:30.974750 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 376/762] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:40:30 2022] POST /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/action => generated 0 bytes in 888 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 22:40:31.033852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:31.034673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:31.045426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:31.046982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:31.048354 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:31.049133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:31.257341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:31.257975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:31.265888 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:31.266356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:31.267291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:31.267735 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:31.309042 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:31.309415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:31.309872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lazy-loading 'fault' on Instance uuid 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:31.387399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:31.394209 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:31.402452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-24ccf16f-dbb2-456c-a9bd-c09f18d5bdf4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1326 microversion: 2.1 time: 0.149756 May 31 22:40:31.418092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 377/763] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:31 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1326 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:31.418642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:31.418642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:31.418642 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b3fa8720-3d70-4d9f-9de4-f3dbe53c9d58 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.380363 May 31 22:40:31.419000 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 387/764] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:31 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:32.119460 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-6e4688c3-31d4-49d0-8a9d-9af55890dbea req-0c716474-095d-4070-8713-64c283c3350e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:32.131758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6e4688c3-31d4-49d0-8a9d-9af55890dbea req-0c716474-095d-4070-8713-64c283c3350e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.132326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6e4688c3-31d4-49d0-8a9d-9af55890dbea req-0c716474-095d-4070-8713-64c283c3350e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.144514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-6e4688c3-31d4-49d0-8a9d-9af55890dbea req-0c716474-095d-4070-8713-64c283c3350e service nova] Creating event network-changed:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:40:32.150603 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-6e4688c3-31d4-49d0-8a9d-9af55890dbea req-0c716474-095d-4070-8713-64c283c3350e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034934 May 31 22:40:32.151696 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 378/765] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:32.430326 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:32.431074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:32.432864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:32.433888 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:32.450306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.451187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.452308 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.453177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.454044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.456810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.459250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.459734 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.530208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.531057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.531671 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lazy-loading 'fault' on Instance uuid 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:32.608559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:32.621903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3edfd86f-5991-482d-bdbd-709b9784d6ec tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 200 len: 1326 microversion: 2.1 time: 0.205042 May 31 22:40:32.624507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 388/766] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:32 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 1326 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:32.634965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:32.635835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:32.643434 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.644067 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.645226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.646114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.870414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:32.881895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:32.887901 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:32.889406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bf86471c-f87a-48c9-911f-b5808771ad2c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.464981 May 31 22:40:32.891777 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 379/767] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:32 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:32.899242 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f7c9eac8-e61b-4c9b-8ee8-791930456eac req-6e53c07a-f693-4935-bea8-189fe3dd535e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:32.924419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f7c9eac8-e61b-4c9b-8ee8-791930456eac req-6e53c07a-f693-4935-bea8-189fe3dd535e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:32.924879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f7c9eac8-e61b-4c9b-8ee8-791930456eac req-6e53c07a-f693-4935-bea8-189fe3dd535e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:32.946249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f7c9eac8-e61b-4c9b-8ee8-791930456eac req-6e53c07a-f693-4935-bea8-189fe3dd535e service nova] Creating event network-changed:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:40:32.963522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f7c9eac8-e61b-4c9b-8ee8-791930456eac req-6e53c07a-f693-4935-bea8-189fe3dd535e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068315 May 31 22:40:32.966542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 380/768] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:33.008559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lazy-loading 'services' on Instance uuid 650d908e-91d4-4a95-abc7-1a9fd5cc2510 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:33.012824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:33.237683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80985bc5-4602-4a02-a439-cab977cd86c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments/f5c2d552-2f62-44e5-9b22-3e2b722cb43b" status: 202 len: 0 microversion: 2.1 time: 0.609675 May 31 22:40:33.239712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 389/769] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:40:32 2022] DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments/f5c2d552-2f62-44e5-9b22-3e2b722cb43b => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:40:33.250155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:33.251587 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:33.259049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.260466 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:33.261794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.263704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:33.296766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c918db67-7264-40bf-a6b5-87d1b14609fb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051659 May 31 22:40:33.297465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 381/770] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:33 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:40:33.650699 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:33.651258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:33.658741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.659218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:33.659984 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.660600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:33.674688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb HTTP/1.1 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:40:33.676390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:40:33.678001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '14bc3b11-0b60-4e5e-b594-f60d8c18c7bb'} May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:33.678801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:40:33.688164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:40:33.689381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:33.689381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8587d4a9-64c4-48c1-88a0-ff685c1811e9 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 404 len: 111 microversion: 2.1 time: 0.040254 May 31 22:40:33.689381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 390/771] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:33 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:40:33.689608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-58fe9191-ffe5-4ca4-bb0d-f1acd4f9cecc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '.version_select at 0x7ff45db508b0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:33.799802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-58fe9191-ffe5-4ca4-bb0d-f1acd4f9cecc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-418908735" status: 202 len: 0 microversion: 2.1 time: 0.115207 May 31 22:40:33.800475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 382/772] 10.222.0.39 () {58 vars in 1217 bytes} [Tue May 31 22:40:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-418908735 => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 22:40:33.912580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:33.913279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:33.920994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:33.923072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:33.934454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.936697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:33.937739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:33.940596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:34.126609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:34.137264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:34.139052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:34.140543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-205180af-6e6b-4e47-b8f2-1a89b72d0c65 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.234855 May 31 22:40:34.141102 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 391/773] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:33 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:34.305946 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:34.311478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:34.312397 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:34.319215 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:34.319671 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:34.320455 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:34.320894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:34.357800 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-45199760-4f4c-4fd1-bdea-ee7ec5f1b715 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052771 May 31 22:40:34.363142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 383/774] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:34 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:34.703899 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-71a63cbb-c370-4dbe-a969-e5cf594b19fa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: .version_select at 0x7ff45e2b34c0>, body: {"keypair": {"name": "tempest-keypair-92344808", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMziL6pCDVS+LcNtMstpekYyg4TYGpYbAvdmDrKjliASagh6J4BWnHQ7ACp6LMmyQ+aWwRti141+CZLpJffWFfWBH2sYkbJfPqMKl8adbr9rMC/CNfi+EoeHMtc/q37LAw=="}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:34.720141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-71a63cbb-c370-4dbe-a969-e5cf594b19fa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for project ae8802f7cc3d492db27311ca9c98c124. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:40:34.723981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-71a63cbb-c370-4dbe-a969-e5cf594b19fa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for user 0a1af4f589cb41af9920e04c2130d49f and project ae8802f7cc3d492db27311ca9c98c124. Resources: {'key_pairs'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:40:34.843684 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-71a63cbb-c370-4dbe-a969-e5cf594b19fa tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.143960 May 31 22:40:34.844284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 392/775] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:40:34 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:35.159109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:35.159859 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:35.167562 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.168034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.168728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.169322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.329840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:35.338541 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:35.340334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:35.341201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2513ee29-f7a5-4125-bebd-e56f665fe03a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.186235 May 31 22:40:35.345409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 384/776] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:35 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:35.371344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:35.372297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:35.378147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.378637 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.379424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.379858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.408077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5a3a42d7-77cc-47e8-97e2-2d0bebd83dfe tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041265 May 31 22:40:35.408612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 393/777] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:35 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:40:35.418241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:35.418745 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:35.425716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.431002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.431002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:35.431002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:35.503276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] HTTP exception thrown: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 is not attached to volume f5c2d552-2f62-44e5-9b22-3e2b722cb43b May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Request method failure captured: May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments/f5c2d552-2f62-44e5-9b22-3e2b722cb43b HTTP/1.1 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpiL5x6r05xUPb1FS0DCOcNHA4GcbnQtyBE4ONdcCjwUjh8bvF_a6-jhPY9GugGWnte1S-HPHkpfWTiclqh2TLbEvBMjTaJt9CEmUlyQ0fEIe63DSe4mf68L_vRDVSvec5AZ-OMHWXGq9n5bo7gmnqt1leJ52V8JT23YfGEsfj9cEC0 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 411823fbbfc24cbf94dc4aff1129889f May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:40:35.516667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_411823fbbfc24cbf94dc4aff1129889f"}]}] May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 411823fbbfc24cbf94dc4aff1129889f May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-TestMinimumBasicScenario-1605999631-project May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 7ad64b6793124cc9b4a5a315cb1aa56a May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestMinimumBasicScenario-1605999631-project May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:40:35.518187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 is not attached to volume f5c2d552-2f62-44e5-9b22-3e2b722cb43b May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'server_id': '650d908e-91d4-4a95-abc7-1a9fd5cc2510', 'id': 'f5c2d552-2f62-44e5-9b22-3e2b722cb43b'} May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f5c2d552-2f62-44e5-9b22-3e2b722cb43b. May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:35.519179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 is not attached to volume f5c2d552-2f62-44e5-9b22-3e2b722cb43b May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 is not attached to volume f5c2d552-2f62-44e5-9b22-3e2b722cb43b May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:35.520771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Returning 404 to user: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 is not attached to volume f5c2d552-2f62-44e5-9b22-3e2b722cb43b {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:35.521843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-26090258-244f-4d6f-b058-45f79a375cd1 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments/f5c2d552-2f62-44e5-9b22-3e2b722cb43b" status: 404 len: 154 microversion: 2.1 time: 0.103977 May 31 22:40:35.521843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 385/778] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:40:35 2022] DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510/os-volume_attachments/f5c2d552-2f62-44e5-9b22-3e2b722cb43b => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:40:36.151408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-02cca66e-b300-4e50-a3c3-946822e0aa6f req-a10e9f31-c032-4e02-bb77-c42286e44a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "name": "network-vif-plugged", "status": "completed", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:36.160646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-02cca66e-b300-4e50-a3c3-946822e0aa6f req-a10e9f31-c032-4e02-bb77-c42286e44a02 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:36.161086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-02cca66e-b300-4e50-a3c3-946822e0aa6f req-a10e9f31-c032-4e02-bb77-c42286e44a02 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:36.173687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-02cca66e-b300-4e50-a3c3-946822e0aa6f req-a10e9f31-c032-4e02-bb77-c42286e44a02 service nova] Creating event network-vif-plugged:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:40:36.186724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-02cca66e-b300-4e50-a3c3-946822e0aa6f req-a10e9f31-c032-4e02-bb77-c42286e44a02 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040269 May 31 22:40:36.188217 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 394/779] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:36.359679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:36.360320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:36.367223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:36.367685 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:36.368546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:36.369548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:36.505142 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:36.514661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:36.517064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:36.518194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-27ff17dd-9e11-413c-b938-eb3d39ba5743 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.162555 May 31 22:40:36.518754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 386/780] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:36 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:36.788814 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:36.789549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:36.796119 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:36.796644 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:36.797510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:36.798017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:36.824082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:40:37.151938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-80d59ce0-f7b0-4928-897d-86324c6b786d tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 204 len: 0 microversion: 2.1 time: 0.367326 May 31 22:40:37.152513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 395/781] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:40:36 2022] DELETE /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:40:37.160588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:37.171289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:37.171289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:37.171289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:37.171289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:37.171656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:37.305146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:37.313341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-49a1cfff-e7b1-4472-97a9-bdf4f68835d4 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.156589 May 31 22:40:37.313890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 387/782] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:37 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:37.456713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1086133788", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "be8b41ab-f3a4-421d-990d-6bcaad944e0b"}], "security_groups": [{"name": "tempest-securitygroup--1424646043"}], "key_name": "tempest-keypair-92344808", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:37.535841 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:37.536457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:37.543456 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:37.543905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:37.544676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:37.545116 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:37.558990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] validate_networks() for [('be8b41ab-f3a4-421d-990d-6bcaad944e0b', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:40:37.675584 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:37.684876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:37.689184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:37.689184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39395454-6dca-4d40-a790-15134fd30a3c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.155765 May 31 22:40:37.689184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 388/783] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:37 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:40:38.009027 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:40:38.010054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:40:38.010539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:40:38.011087 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:40:38.011495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:40:38.013524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:38.020881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.021320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.022104 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.022532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.039381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for project ae8802f7cc3d492db27311ca9c98c124. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:40:38.043144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Getting quotas for user 0a1af4f589cb41af9920e04c2130d49f and project ae8802f7cc3d492db27311ca9c98c124. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:40:38.054747 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:40:38.057059 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:40:38.188344 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8efa9090-e367-4421-b6ef-9cddd54e2490 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.736130 May 31 22:40:38.189007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 396/784] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:40:37 2022] POST /compute/v2.1/servers => generated 402 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:40:38.199275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-432cc8fc-db8a-42fd-90a9-34db46409277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:38.199973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-432cc8fc-db8a-42fd-90a9-34db46409277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:38.256678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-432cc8fc-db8a-42fd-90a9-34db46409277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:38.264263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-432cc8fc-db8a-42fd-90a9-34db46409277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1236 microversion: 2.1 time: 0.069120 May 31 22:40:38.264826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 389/785] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:38 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:38.329885 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:38.330742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:38.338466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.338946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.339717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.340410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.469707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:38.477197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d8253fe3-e14e-42df-8bd5-3daac90408b6 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.151667 May 31 22:40:38.477755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 397/786] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:38 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:38.705670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:38.706304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:38.713776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.714225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.715046 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:38.715548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:38.844305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:38.852239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:38.853843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:38.854965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-fc54d2b6-c39f-4004-aceb-50c0a1365191 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.153448 May 31 22:40:38.855513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 390/787] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:38 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:39.281305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:39.281933 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:39.288054 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.288497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:39.289257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.289690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:39.353013 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:39.360367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b21642ae-81af-400c-98e2-9b8b6c5fd6ae tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1240 microversion: 2.1 time: 0.082946 May 31 22:40:39.360916 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 398/788] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:39 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1240 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:39.494110 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:39.494804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:39.500788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.501231 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:39.501988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.502420 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:39.629470 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:39.637464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a7e5a9df-486c-464a-8456-e7a3a734aecb tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.147958 May 31 22:40:39.638022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 391/789] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:39 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:39.872624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:39.873235 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:39.879783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.880172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:39.880929 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:39.881396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:40.010213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:40.018058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:40.019609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:40.020703 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c34ff005-538c-4f98-9295-8f6baccab9f3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.152084 May 31 22:40:40.021254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 399/790] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:39 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:40.376644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:40.377260 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:40.379626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:40.384504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:40.384962 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:40.385755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:40.386197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:40.457856 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:40.465832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-81acfa34-b007-45b7-a82c-e17a1dac0ede tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1240 microversion: 2.1 time: 0.093102 May 31 22:40:40.466395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 392/791] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:40 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:40.656004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:40.656612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:40.662662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:40.663142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:40.663905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:40.664343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:40.798990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:40.807062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a4d56f57-94c1-4690-a3af-9e3db6e2b7fa tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.154852 May 31 22:40:40.807704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 400/792] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:40 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:41.038619 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:41.039192 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:41.045354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.045832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.046620 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.047088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.174954 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:41.183795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:41.185315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:41.186426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ed8c5a10-e67a-42a3-8734-5a381620e1f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.152193 May 31 22:40:41.187019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 393/793] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:41 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:41.487310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:41.487922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:41.495447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.495447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.496036 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.496469 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.555391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:41.563138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f5f62c24-42f6-459f-bc09-12ff4713faa5 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1232 microversion: 2.1 time: 0.079647 May 31 22:40:41.563693 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 401/794] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:41 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1232 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:41.823935 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:41.824578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:41.831280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.831726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.832492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:41.832926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:41.958965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:41.966960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4cde8d7c-e771-4a9b-af94-ced7121eb630 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.146839 May 31 22:40:41.967547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 394/795] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:41 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:42.205420 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:42.206040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:42.212190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.212635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.213392 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.213829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.343544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:42.351384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:42.353565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:42.354728 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-83413079-d4e2-4960-93d0-a129923fb3a1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.153291 May 31 22:40:42.355510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 402/796] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:42 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:42.580374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:42.580909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:42.587437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.587890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.588668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.589110 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.652945 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:42.660332 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5edf803a-6d93-4381-a8fd-9eb1c42ea132 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1232 microversion: 2.1 time: 0.083997 May 31 22:40:42.660891 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 395/797] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:42 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1232 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:42.956509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:42.957026 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:42.963922 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.964371 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.965130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.965565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.984239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:42.984860 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:42.991300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.991755 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.992528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:42.992970 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:42.997008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:43.047690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'services' on Instance uuid 9722d9d2-d3d8-4015-9c90-6c61603f8728 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:43.120998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:43.128474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-491d65d8-c5a9-419a-a254-1bc595ae36e0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.148081 May 31 22:40:43.129029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 396/798] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:42 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:43.237072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ffa850ce-a158-4f89-bc6d-9bc2d0ac6394 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments/ccad5c06-1034-4658-b9bb-0da6c6f1ff82" status: 202 len: 0 microversion: 2.1 time: 0.284253 May 31 22:40:43.237839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 403/799] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:40:42 2022] DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments/ccad5c06-1034-4658-b9bb-0da6c6f1ff82 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:40:43.245941 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:43.246983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:43.253011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.253458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.254225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.254662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.284018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c8307995-f273-4427-bf28-b74be6531af4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041976 May 31 22:40:43.284568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 397/800] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:43 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:43.372355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:43.373014 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:43.379226 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.379675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.380442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.380877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.507950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:43.516457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:43.517963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:43.519080 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-82cedfa3-1f02-42c6-acb4-e2f5c0838991 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.151125 May 31 22:40:43.519629 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 404/801] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:43 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:43.677861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:43.678476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:43.684976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.688973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.688973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:43.688973 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:43.747178 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:43.754812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ac1f73c3-f308-49d4-97a4-874786bc5e7c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1232 microversion: 2.1 time: 0.081255 May 31 22:40:43.755486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 398/802] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:43 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1232 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:44.146043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:44.146650 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:44.153700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.154149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.155015 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.155526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.294932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:44.297169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:44.298162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:44.303675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57fb4c0c-44a2-441c-acc5-5047c250e790 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1552 microversion: 2.1 time: 0.161426 May 31 22:40:44.304457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 405/803] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:44 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:44.304897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.305346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.306628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.307094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.337352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ee43b27e-3be0-4784-8aa4-e787d3e50b2a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 May 31 22:40:44.337824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 399/804] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:44 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:44.536113 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:44.536743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:44.543370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.543811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.544573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.545009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.756570 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:44.759040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:44.765440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:44.771628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:44.772236 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:44.776171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:44.777309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d2c8928-5441-4d39-8eaf-afd9a8989126 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1405 microversion: 2.20 time: 0.245091 May 31 22:40:44.778199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 406/805] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:44 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1405 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:44.779452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.780166 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.781016 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:44.781524 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:44.844729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:44.852202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-218ed063-75c6-4c3e-b1ee-c2950acf4766 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1288 microversion: 2.1 time: 0.084502 May 31 22:40:44.853265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 400/806] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:44 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:45.063214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-472603ae-f877-4c8f-bce2-f63dbab6aa3d req-6c00e77f-cb57-45cd-b8b7-5242ceb2ce32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "650d908e-91d4-4a95-abc7-1a9fd5cc2510", "name": "network-vif-deleted", "tag": "dd4dada1-fee7-4496-8e97-d81ad342e789"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:45.068721 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-472603ae-f877-4c8f-bce2-f63dbab6aa3d req-6c00e77f-cb57-45cd-b8b7-5242ceb2ce32 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.069280 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-472603ae-f877-4c8f-bce2-f63dbab6aa3d req-6c00e77f-cb57-45cd-b8b7-5242ceb2ce32 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.080054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-472603ae-f877-4c8f-bce2-f63dbab6aa3d req-6c00e77f-cb57-45cd-b8b7-5242ceb2ce32 service nova] Creating event network-vif-deleted:dd4dada1-fee7-4496-8e97-d81ad342e789 for instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 on hv-cinder-84414 May 31 22:40:45.085226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-472603ae-f877-4c8f-bce2-f63dbab6aa3d req-6c00e77f-cb57-45cd-b8b7-5242ceb2ce32 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028172 May 31 22:40:45.086281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 401/807] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:40:45.168533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.169141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.180529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.180529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.180529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.180529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.200170 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dd7c67c5-6710-4a98-9bb7-dfe76566c294 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/ips" status: 200 len: 150 microversion: 2.1 time: 0.233673 May 31 22:40:45.206389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 407/808] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:40:44 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/ips => generated 150 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:45.322680 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.323407 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.329647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.330098 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.330885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.331317 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.353604 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.358680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.372058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.373385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.374873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.376245 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.417226 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:45.420645 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c19b5bcf-b406-4423-a97a-b92912c66029 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075464 May 31 22:40:45.421448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 408/809] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:45 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:40:45.431291 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b7f5eb3e-5a36-42dd-b851-1e16c5c30f34 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1510 microversion: 2.1 time: 0.113184 May 31 22:40:45.431878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 402/810] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:45 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1510 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:45.795810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.801624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.802834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.803289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.804052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.804493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.873474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.875066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.882633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.883084 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.883902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.884876 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.939844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:45.948552 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:45.949923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:45.952002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:45.952002 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d72c51a8-7166-44a9-b109-a05c09090aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1598 microversion: 2.20 time: 0.159647 May 31 22:40:45.955500 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 409/811] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:40:45 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1598 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:40:45.957635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ae4780cf-d8e4-4b86-9cb9-a22d7b3a8b0d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1288 microversion: 2.1 time: 0.091744 May 31 22:40:45.958218 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 403/812] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:45 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1288 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:45.968705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:45.969302 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:45.975464 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.975912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:45.976710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:45.977145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.052651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-462f9642-136f-4076-aee2-c5889b8427f9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.087760 May 31 22:40:46.056654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 410/813] 10.222.0.39 () {60 vars in 1315 bytes} [Tue May 31 22:40:45 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:40:46.435039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:46.436465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:46.442617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.445864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.445864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.445864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.449514 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:46.450774 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:46.457157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.457614 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.458408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.459032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.476975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-62e04d33-9d3a-469e-a1f7-dd8a1e306b04 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045950 May 31 22:40:46.477547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 404/814] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:46 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:46.536745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:46.544700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7505170b-ee79-491f-bb08-5030bf3f13bd tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1342 microversion: 2.1 time: 0.099702 May 31 22:40:46.545263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 411/815] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:46 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:46.974535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:46.975334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:46.981791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.982239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:46.983051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:46.983484 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.047842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:47.055687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-33642fb3-bcb9-45f1-ba31-88b624eb0277 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1288 microversion: 2.1 time: 0.085189 May 31 22:40:47.056252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 405/816] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:46 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1288 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:47.099796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-3724ff27-d4e9-4ba3-9168-9558397856ee req-70b52666-2a34-45fe-9df0-6e56b683ca51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:47.107758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-3724ff27-d4e9-4ba3-9168-9558397856ee req-70b52666-2a34-45fe-9df0-6e56b683ca51 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.108210 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-3724ff27-d4e9-4ba3-9168-9558397856ee req-70b52666-2a34-45fe-9df0-6e56b683ca51 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.119228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-3724ff27-d4e9-4ba3-9168-9558397856ee req-70b52666-2a34-45fe-9df0-6e56b683ca51 service nova] Creating event network-changed:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:40:47.124199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-3724ff27-d4e9-4ba3-9168-9558397856ee req-70b52666-2a34-45fe-9df0-6e56b683ca51 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028201 May 31 22:40:47.124788 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 412/817] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:47.489055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:47.489989 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:47.496640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.513880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.513880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.513880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.527689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5b9c9fea-6beb-4134-88de-b36af647846d tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042541 May 31 22:40:47.528253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 406/818] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:47 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:47.563127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:47.563841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:47.570549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.571072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.571878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.572321 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.603551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:47.604009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:47.604474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lazy-loading 'fault' on Instance uuid 650d908e-91d4-4a95-abc7-1a9fd5cc2510 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:47.653872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:47.661599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8dc0d379-ed77-4590-972f-9cb6aca69a61 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1347 microversion: 2.1 time: 0.103122 May 31 22:40:47.662181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 413/819] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:47 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1347 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:48.072544 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:48.073152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:48.079914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.080391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.081161 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.081624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.141818 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:48.151352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-aa7c1ce7-4826-4f95-91c8-24bb1bdcb27d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1288 microversion: 2.1 time: 0.082648 May 31 22:40:48.152357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 407/820] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:48 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1288 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:48.538393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:48.539277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:48.541205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:48.541863 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=10 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:48.546880 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.547323 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.550935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.550935 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.579565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-deaae4db-b01a-40c7-8797-ef054c9adef5 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045101 May 31 22:40:48.580727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 414/821] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:48 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:48.680145 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:48.682193 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:48.684412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:48.689301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.689746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.690513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.690974 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.722346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:48.722826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:48.723275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lazy-loading 'fault' on Instance uuid 650d908e-91d4-4a95-abc7-1a9fd5cc2510 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:48.766942 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ad64b6793124cc9b4a5a315cb1aa56a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '411823fbbfc24cbf94dc4aff1129889f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:48.774389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0e36e495-7d85-45ac-aefe-409af5374c94 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 200 len: 1347 microversion: 2.1 time: 0.098553 May 31 22:40:48.774994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 408/822] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:48 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:49.169975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:49.170996 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:49.184876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.185686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.186675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.187345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.291316 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:49.305622 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-260d55aa-7b90-4209-8182-89d87a786243 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1306 microversion: 2.1 time: 0.140597 May 31 22:40:49.315884 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 415/823] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:49 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1306 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:49.598487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:49.598487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:49.606297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.606753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.607794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.608164 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.642265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ddf26d00-07ca-4fe3-aace-8db93047699a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048527 May 31 22:40:49.642265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 409/824] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:40:49 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:40:49.726398 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:49.726920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:49.735721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.742418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.742418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.742418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.765019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:40:49.792177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:49.793952 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] [instance: 650d908e-91d4-4a95-abc7-1a9fd5cc2510] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:49.808898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.808898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.808898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:49.808898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:49.817898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] HTTP exception thrown: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Request method failure captured: May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 HTTP/1.1 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpiL5x6r05xUPb1FS0DCOcNHA4GcbnQtyBE4ONdcCjwUjh8bvF_a6-jhPY9GugGWnte1S-HPHkpfWTiclqh2TLbEvBMjTaJt9CEmUlyQ0fEIe63DSe4mf68L_vRDVSvec5AZ-OMHWXGq9n5bo7gmnqt1leJ52V8JT23YfGEsfj9cEC0 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 411823fbbfc24cbf94dc4aff1129889f May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:40:49.819898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/411823fbbfc24cbf94dc4aff1129889f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_411823fbbfc24cbf94dc4aff1129889f"}]}] May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 411823fbbfc24cbf94dc4aff1129889f May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1605999631 May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-TestMinimumBasicScenario-1605999631-project May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 7ad64b6793124cc9b4a5a315cb1aa56a May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestMinimumBasicScenario-1605999631-project May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. May 31 22:40:49.822068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '650d908e-91d4-4a95-abc7-1a9fd5cc2510'} May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:49.823072 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. May 31 22:40:49.832182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:49.833520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Returning 404 to user: Instance 650d908e-91d4-4a95-abc7-1a9fd5cc2510 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:49.833520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7b6826e4-f982-4efc-a963-43cbc8c08fa5 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510" status: 404 len: 111 microversion: 2.1 time: 0.035912 May 31 22:40:49.833520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 410/825] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:49 2022] GET /compute/v2.1/servers/650d908e-91d4-4a95-abc7-1a9fd5cc2510 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:40:49.839350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-60347001-13f0-4c11-be35-8c2933e570c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] Calling method '.version_select at 0x7ff45dc8e430>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:49.944377 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-60347001-13f0-4c11-be35-8c2933e570c0 tempest-TestMinimumBasicScenario-1605999631 tempest-TestMinimumBasicScenario-1605999631-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-705323056" status: 202 len: 0 microversion: 2.1 time: 0.109260 May 31 22:40:49.947109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 411/826] 10.222.0.39 () {58 vars in 1268 bytes} [Tue May 31 22:40:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-705323056 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:40:50.076209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a02bf77-0ed8-46d0-9e3b-4191af935dd1"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:50.079189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:50.100839 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.101494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.109233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.109699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.144798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cc59e7b7-43a6-4c46-b416-f21cae632550 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 204 len: 0 microversion: 2.1 time: 0.422085 May 31 22:40:50.146017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 416/827] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:40:49 2022] DELETE /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:40:50.329971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:50.329971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:50.335626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.336462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.338174 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.338802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.493166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:50.500869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6d74932c-4f31-4b13-a1e1-e877d60a2e14 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1690 microversion: 2.1 time: 0.347182 May 31 22:40:50.501367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 417/828] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:50 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1690 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:50.568267 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:50.568890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:50.576963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.577524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.578239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:50.578740 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:50.721917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:50.729598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3098bf43-2602-403f-a6a6-630907a15992 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.221768 May 31 22:40:50.733709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 418/829] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:50 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:51.074606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-d51577be-eb45-4dda-9617-5de5b05228ff req-4b0c38f9-b230-439a-9f84-888c9b4335fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2", "tag": "dbe9e018-9861-45dd-a2ff-8875ecb84b63"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:51.083218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d51577be-eb45-4dda-9617-5de5b05228ff req-4b0c38f9-b230-439a-9f84-888c9b4335fa service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:51.083668 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-d51577be-eb45-4dda-9617-5de5b05228ff req-4b0c38f9-b230-439a-9f84-888c9b4335fa service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:51.095077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-d51577be-eb45-4dda-9617-5de5b05228ff req-4b0c38f9-b230-439a-9f84-888c9b4335fa service nova] Creating event network-changed:dbe9e018-9861-45dd-a2ff-8875ecb84b63 for instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 on hv-cinder-84414 May 31 22:40:51.100070 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-d51577be-eb45-4dda-9617-5de5b05228ff req-4b0c38f9-b230-439a-9f84-888c9b4335fa service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093642 May 31 22:40:51.104190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 419/830] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:51.518158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:51.518886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:51.525381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:51.525892 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:51.526699 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:51.527183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:51.746852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:51.754263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5b33d880-3447-4117-99b8-ab61d08d3f52 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1690 microversion: 2.1 time: 0.240580 May 31 22:40:51.754846 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 420/831] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:51 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1690 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:51.768939 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:51.769574 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:51.775902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:51.776419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:51.777196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:51.777631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:52.261930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:52.269413 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-608d08f0-8df3-4cf2-8a44-9322f20bd6d7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.504134 May 31 22:40:52.269984 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 421/832] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:51 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:52.771882 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:52.772694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:52.779211 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:52.779655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:52.780410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:52.780844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:52.993133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:53.001999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-66b2c207-c54f-4a13-abe7-2f559012eba3 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1690 microversion: 2.1 time: 0.233889 May 31 22:40:53.002676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 422/833] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:52 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1690 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:53.285684 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:53.286457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:53.292975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:53.295711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:53.295711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:53.295711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:53.310556 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:53.475544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:53.488895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-86cd9c49-3a3b-4656-bf2c-0647bcb08173 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.207251 May 31 22:40:53.491074 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 423/834] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:53 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:40:54.026471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:54.028419 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:54.036878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:54.038487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:54.042484 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:54.043461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:54.330109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3608ee0f-305b-4147-92d0-8cbe2b84d576 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.261937 May 31 22:40:54.337614 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 412/835] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:40:50 2022] POST /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments => generated 194 bytes in 4270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:40:54.384573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:54.393824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-00455751-075a-49dd-9237-2745e02ec398 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1690 microversion: 2.1 time: 0.376095 May 31 22:40:54.398609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 424/836] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:54 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1690 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:54.513741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:54.514695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:54.531144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:54.531800 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:54.533081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:54.533686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:54.558357 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:40:54.853127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:54.863169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b58a936a-d930-42c9-8c8e-162125c8b8c0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.354734 May 31 22:40:54.866601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 413/837] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:54 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:55.032515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-ff27af2b-fa47-4b14-b35a-816219e3f8bf req-63bcdd44-8f44-4325-9035-72600f296c21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9722d9d2-d3d8-4015-9c90-6c61603f8728", "name": "network-vif-deleted", "tag": "31787e65-a9e2-4d65-b488-3c55b69adc21"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:55.044333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ff27af2b-fa47-4b14-b35a-816219e3f8bf req-63bcdd44-8f44-4325-9035-72600f296c21 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:55.045031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ff27af2b-fa47-4b14-b35a-816219e3f8bf req-63bcdd44-8f44-4325-9035-72600f296c21 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:55.057781 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-ff27af2b-fa47-4b14-b35a-816219e3f8bf req-63bcdd44-8f44-4325-9035-72600f296c21 service nova] Creating event network-vif-deleted:31787e65-a9e2-4d65-b488-3c55b69adc21 for instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 on hv-cinder-84414 May 31 22:40:55.063920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-ff27af2b-fa47-4b14-b35a-816219e3f8bf req-63bcdd44-8f44-4325-9035-72600f296c21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034849 May 31 22:40:55.065085 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 425/838] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:40:55.419058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:55.419951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:55.428625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:55.429079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:55.433483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:55.433967 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:55.547038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:55.567713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ab49df04-b8c1-47bd-a1d6-b80ba7aa8096 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1331 microversion: 2.1 time: 0.159848 May 31 22:40:55.569040 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 414/839] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:55 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1331 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:55.885003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:55.886030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:55.893786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:55.894221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:55.895585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:55.896603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:56.220586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:56.226147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4fe8e821-ec52-4dd3-9d4a-1d0eb29510bd tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.348804 May 31 22:40:56.246021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 426/840] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:55 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:56.585577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:56.586181 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:56.594047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:56.594503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:56.595340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:56.598928 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:56.630919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:56.631371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:56.631831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'fault' on Instance uuid 9722d9d2-d3d8-4015-9c90-6c61603f8728 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:56.681171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:56.690199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-78e416ce-2ce4-48ab-81ee-5171aa71f88b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 200 len: 1336 microversion: 2.1 time: 0.108586 May 31 22:40:56.700760 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 415/841] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:56 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 1336 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:57.245577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:57.246269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:57.253372 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:57.253827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:57.254607 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:57.255075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:57.459389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:57.466911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-291dce0a-0ce6-497a-b0a3-b7236c10ba52 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.226018 May 31 22:40:57.467482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 427/842] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:57 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:57.713387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:57.714013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 9722d9d2-d3d8-4015-9c90-6c61603f8728] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:57.721301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:57.726878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:57.726878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:57.726878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:57.738570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] HTTP exception thrown: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Request method failure captured: May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 HTTP/1.1 May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEmgsIR1PKebLwbTtBv5_bGKBIdJ1FudIYqAYv6Vl-hTQfQ6sgLA1jR7riu4CBMrTlO6YycpQS0G6A7mBg-mchauL_8g5fI7qA4jCLL7etM7QnSywfyKnssNi5Q5YMi0dsrBZH_HE3JXWt4ID4o9VFrtV4yqyKJLwtFfNUYOTe2FM May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: dbc9abb548994abba42919b7d850be0b May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:40:57.740304 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dbc9abb548994abba42919b7d850be0b"}]}] May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: dbc9abb548994abba42919b7d850be0b May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a5a154e334e49db92d41cefaf75ef27 May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. May 31 22:40:57.741799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '9722d9d2-d3d8-4015-9c90-6c61603f8728'} May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:40:57.745767 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. May 31 22:40:57.747204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:40:57.748472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Returning 404 to user: Instance 9722d9d2-d3d8-4015-9c90-6c61603f8728 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:40:57.748472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f957b70-a9e3-455d-a815-70ae582c1ecb tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728" status: 404 len: 111 microversion: 2.1 time: 0.032875 May 31 22:40:57.748472 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 416/843] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:57 2022] GET /compute/v2.1/servers/9722d9d2-d3d8-4015-9c90-6c61603f8728 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:40:57.750928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4980dee6-e60a-423e-bd3b-583242d4bce4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '.version_select at 0x7ff45e46d670>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:57.810632 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4980dee6-e60a-423e-bd3b-583242d4bce4 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682099172" status: 202 len: 0 microversion: 2.1 time: 0.063828 May 31 22:40:57.811362 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 428/844] 10.222.0.39 () {58 vars in 1220 bytes} [Tue May 31 22:40:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1682099172 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:40:58.485998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:58.487936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:58.501746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:58.502324 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:58.503224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:58.503729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:58.764971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:58.773867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-937f2c6e-eddc-4870-87c7-07f1a8f918a8 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.292991 May 31 22:40:58.774474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 417/845] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:58 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:40:59.753106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:40:59.754290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:59.762039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:59.762738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:59.763488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:59.764007 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:59.789256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lazy-loading 'flavor' on Instance uuid f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:40:59.799348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:40:59.800017 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:40:59.807153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:59.807790 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:59.808731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:40:59.809325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:40:59.966817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:40:59.984611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0573be41-6c41-4d1c-8927-949b27def68d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.197429 May 31 22:40:59.985311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 418/846] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:40:59 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:00.074032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9261a552-d6dc-4d1e-a875-9c0b9bc4f695 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "POST /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09/action" status: 202 len: 0 microversion: 2.1 time: 0.324561 May 31 22:41:00.075223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 429/847] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:40:59 2022] POST /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09/action => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 31 22:41:00.084944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:00.085756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:00.094292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:00.095826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:00.096689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:00.097369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:00.304193 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:00.315314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5c6bd924-b723-4869-b65c-846da404cac3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.234524 May 31 22:41:00.315897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 419/848] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:00 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:00.538479 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-cfb1f8d6-43c0-42a8-bf86-0bc102ec23ad req-53ecf204-f86d-4a93-a421-1df3385a052a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2", "name": "network-vif-plugged", "status": "completed", "tag": "dbe9e018-9861-45dd-a2ff-8875ecb84b63"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:00.550081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cfb1f8d6-43c0-42a8-bf86-0bc102ec23ad req-53ecf204-f86d-4a93-a421-1df3385a052a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:00.550523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-cfb1f8d6-43c0-42a8-bf86-0bc102ec23ad req-53ecf204-f86d-4a93-a421-1df3385a052a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:00.562339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-cfb1f8d6-43c0-42a8-bf86-0bc102ec23ad req-53ecf204-f86d-4a93-a421-1df3385a052a service nova] Creating event network-vif-plugged:dbe9e018-9861-45dd-a2ff-8875ecb84b63 for instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 on hv-cinder-84414 May 31 22:41:00.567155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-cfb1f8d6-43c0-42a8-bf86-0bc102ec23ad req-53ecf204-f86d-4a93-a421-1df3385a052a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032767 May 31 22:41:00.567734 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 430/849] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:01.001511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:01.002250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:01.008811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.009265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.010056 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.010487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.143439 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:01.151399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-321a699d-b447-4f7a-a13f-b105fbcfe2e4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.153840 May 31 22:41:01.151960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 420/850] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:00 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:01.327454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:01.328047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:01.333232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:01.333884 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:01.334387 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.337491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.337491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.337491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.341864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.342311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.343131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.343565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.361835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:41:01.473387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:01.481136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-52cabbaf-fd3d-4321-a94e-187854eb9419 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.151716 May 31 22:41:01.481900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 421/851] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:01 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:01.710663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0027cf1c-9b98-42c2-9d4c-c85cb3694dbc tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 204 len: 0 microversion: 2.1 time: 0.387749 May 31 22:41:01.711282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 431/852] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:41:01 2022] DELETE /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:41:01.719640 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:01.720262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:01.726502 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.727007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.727781 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:01.728241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:01.859873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:01.867518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ddba8e0c-d4c8-4b58-978f-c73bf5b3b082 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1507 microversion: 2.1 time: 0.151773 May 31 22:41:01.868700 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 422/853] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:01 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:02.170178 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:02.171047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:02.176028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:02.178243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.178695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:02.179485 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.179919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:02.307268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:02.314631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bcf5f47d-ff26-4415-bb7e-cef94dd58e06 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.150003 May 31 22:41:02.315227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 432/854] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:02 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:02.498643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:02.499403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:02.505987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.506436 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:02.507244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.507688 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:02.648930 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:02.657159 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f819498b-9fe8-467a-b001-74200e3e9853 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.162408 May 31 22:41:02.657724 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 423/855] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:02 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:02.885760 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:02.886365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:02.893629 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.894079 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:02.894896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:02.895333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:03.025440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:03.032746 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-60207e6e-343a-4a95-a2a4-20461fac80cf tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1507 microversion: 2.1 time: 0.151478 May 31 22:41:03.033307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 433/856] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:02 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1507 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:03.331489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:03.332095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:03.338828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:03.339278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:03.340029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:03.340460 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:03.467095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:03.474536 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-79f3f9f3-6446-4970-ae05-f11761b4e527 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1362 microversion: 2.1 time: 0.146981 May 31 22:41:03.475173 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 424/857] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:03 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:03.673426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:03.673992 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:03.680938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:03.681422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:03.682190 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:03.682633 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:03.809382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:03.816810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a5dc2b16-c1f9-49c9-96f1-7c7ee67ab970 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.147329 May 31 22:41:03.817379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 434/858] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:03 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:04.053008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:04.053625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:04.060716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.061174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.061944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.062387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.190411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:04.197940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1da49169-3eeb-4266-a696-1cc765c86137 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1507 microversion: 2.1 time: 0.149117 May 31 22:41:04.198514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 425/859] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:04 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:04.491242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:04.491851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:04.498285 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.498732 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.499521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.499953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.628489 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:04.636834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-263c48ad-11d1-45a8-8526-05ba3e4d899a tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1548 microversion: 2.1 time: 0.148511 May 31 22:41:04.637400 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 435/860] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:04 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:04.653391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:04.653889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:04.660068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.660522 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.661292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.661731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.740432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dff91573-1e5c-4b98-bd79-887e75ec0256 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091336 May 31 22:41:04.741027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 426/861] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:41:04 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:04.834697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:04.835324 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:04.841800 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.842253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.843026 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:04.843463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:04.973872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:04.981573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2954c6fc-b9d6-4034-b8d2-4cf3f26fe914 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.150676 May 31 22:41:04.982100 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 436/862] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:04 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:05.214662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:05.215305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:05.222657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:05.223160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:05.223943 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:05.224418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:05.701682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:05.711897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-501137ff-2c22-45c8-b7e2-da0626662e9b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1507 microversion: 2.1 time: 0.501529 May 31 22:41:05.712858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 427/863] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:05 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1507 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:05.832327 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-0f1fc745-9d98-424e-bb71-b41919e38524 req-a5e22064-9011-428e-9b44-fa4fc1245610 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d93938-cb2e-41e4-88b5-70bea066592f", "name": "network-vif-deleted", "tag": "95f303ca-5d62-42f3-84df-9c81bf9bc698"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:05.842489 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0f1fc745-9d98-424e-bb71-b41919e38524 req-a5e22064-9011-428e-9b44-fa4fc1245610 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:05.844717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-0f1fc745-9d98-424e-bb71-b41919e38524 req-a5e22064-9011-428e-9b44-fa4fc1245610 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:05.857381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-0f1fc745-9d98-424e-bb71-b41919e38524 req-a5e22064-9011-428e-9b44-fa4fc1245610 service nova] Creating event network-vif-deleted:95f303ca-5d62-42f3-84df-9c81bf9bc698 for instance 20d93938-cb2e-41e4-88b5-70bea066592f on hv-cinder-84414 May 31 22:41:05.862522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-0f1fc745-9d98-424e-bb71-b41919e38524 req-a5e22064-9011-428e-9b44-fa4fc1245610 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 May 31 22:41:05.863540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 437/864] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:05.999274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:06.000737 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:06.018412 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.018832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.019617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.020052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.047337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-34d63874-a9b2-49aa-b223-091c15c39271 req-73a1d27c-8760-407d-aa49-99354c296823 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2", "tag": "dbe9e018-9861-45dd-a2ff-8875ecb84b63"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:06.056299 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-34d63874-a9b2-49aa-b223-091c15c39271 req-73a1d27c-8760-407d-aa49-99354c296823 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.056744 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-34d63874-a9b2-49aa-b223-091c15c39271 req-73a1d27c-8760-407d-aa49-99354c296823 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.070443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-34d63874-a9b2-49aa-b223-091c15c39271 req-73a1d27c-8760-407d-aa49-99354c296823 service nova] Creating event network-changed:dbe9e018-9861-45dd-a2ff-8875ecb84b63 for instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 on hv-cinder-84414 May 31 22:41:06.075830 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-34d63874-a9b2-49aa-b223-091c15c39271 req-73a1d27c-8760-407d-aa49-99354c296823 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032953 May 31 22:41:06.077134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 438/865] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:06.214587 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:06.224692 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b76bb865-d386-400a-848e-fd279facb4c9 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.229910 May 31 22:41:06.226826 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 428/866] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:05 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:06.280365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a02bf77-0ed8-46d0-9e3b-4191af935dd1"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:06.281973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:06.289300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.290711 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.291997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.292692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.378449 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: POST /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments HTTP/1.1 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 74 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:41:06.380196 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {"volumeAttachment": {"volumeId": "2a02bf77-0ed8-46d0-9e3b-4191af935dd1"}} May 31 22:41:06.381792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'server_id': '045c3d9d-a2aa-4c66-8236-724814eddc25', 'body': {'volumeAttachment': {'volumeId': '2a02bf77-0ed8-46d0-9e3b-4191af935dd1'}}} May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:06.382712 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:06.384512 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 400 to user: Invalid volume: volume 2a02bf77-0ed8-46d0-9e3b-4191af935dd1 is already attached to instances: 045c3d9d-a2aa-4c66-8236-724814eddc25 {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f1d3858-b86c-4cdc-9937-0680a3e94523 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113828 May 31 22:41:06.385794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 439/867] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:41:06 2022] POST /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 31 22:41:06.442534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:06.443063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:06.449628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.450079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.450871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.451336 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.532213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'services' on Instance uuid 045c3d9d-a2aa-4c66-8236-724814eddc25 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:41:06.728556 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:06.729169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:06.735441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.735902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.736737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.737186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.742035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:06.771912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.772424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.773335 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lazy-loading 'fault' on Instance uuid 20d93938-cb2e-41e4-88b5-70bea066592f {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:41:06.798319 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8d72a1a9-7998-4a45-834e-5d92ec9d57e1 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments/2a02bf77-0ed8-46d0-9e3b-4191af935dd1" status: 202 len: 0 microversion: 2.1 time: 0.359556 May 31 22:41:06.799476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 429/868] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:41:06 2022] DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments/2a02bf77-0ed8-46d0-9e3b-4191af935dd1 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:41:06.815713 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:06.817704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:06.826388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:06.826567 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.827036 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.827811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:06.828425 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:06.836334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-11ef20ad-1b06-41bb-900c-bc382fd8952a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 200 len: 1311 microversion: 2.1 time: 0.111542 May 31 22:41:06.838391 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 440/869] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:06 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:06.842603 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:06.877106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ac40ab7c-9870-4686-83db-b84ff00eab45 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073027 May 31 22:41:06.878262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 430/870] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:41:06 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:41:07.242466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:07.243172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:07.260998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.260998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.260998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.260998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.390267 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:07.397900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7b053c45-65bf-4b81-8fd3-d3e473e72d54 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.159343 May 31 22:41:07.398639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 441/871] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:07 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:07.859914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:07.860602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: 20d93938-cb2e-41e4-88b5-70bea066592f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:07.867505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.869977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.869977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.869977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.882646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] HTTP exception thrown: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Request method failure captured: May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f HTTP/1.1 May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEmgsIR1PKebLwbTtBv5_bGKBIdJ1FudIYqAYv6Vl-hTQfQ6sgLA1jR7riu4CBMrTlO6YycpQS0G6A7mBg-mchauL_8g5fI7qA4jCLL7etM7QnSywfyKnssNi5Q5YMi0dsrBZH_HE3JXWt4ID4o9VFrtV4yqyKJLwtFfNUYOTe2FM May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: dbc9abb548994abba42919b7d850be0b May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:41:07.884881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dbc9abb548994abba42919b7d850be0b"}]}] May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: dbc9abb548994abba42919b7d850be0b May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a5a154e334e49db92d41cefaf75ef27 May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. May 31 22:41:07.886240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '20d93938-cb2e-41e4-88b5-70bea066592f'} May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:41:07.887030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. May 31 22:41:07.888254 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:07.890553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Returning 404 to user: Instance 20d93938-cb2e-41e4-88b5-70bea066592f could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:41:07.890553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6ab1b57e-b308-47a7-be29-5dd493f63459 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f" status: 404 len: 111 microversion: 2.1 time: 0.030846 May 31 22:41:07.890553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 431/872] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:07 2022] GET /compute/v2.1/servers/20d93938-cb2e-41e4-88b5-70bea066592f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:41:07.891098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:07.891647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:07.894964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:07.895505 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:07.897318 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.897768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.898557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.899004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.902272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.902711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.903545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.904389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.928259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-151472ea-4413-40db-b0e8-055a37dae761 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042644 May 31 22:41:07.928818 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 442/873] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:41:07 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 22:41:07.929812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:41:07.985487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:07.985987 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:07.991970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.992418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:07.993208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:07.993646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.019682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:41:08.181084 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bb4d9c2f-e9d7-42c4-a243-3fc76bd9c636 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 204 len: 0 microversion: 2.1 time: 0.289255 May 31 22:41:08.181648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 432/874] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:41:07 2022] DELETE /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 22:41:08.189935 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:08.190618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:08.197310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.197756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.198512 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.199041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.289259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0e04f676-bbe5-4182-89d7-cf21c269d380 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 204 len: 0 microversion: 2.1 time: 0.307248 May 31 22:41:08.289881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 443/875] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:41:07 2022] DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 22:41:08.298529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:08.299250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:08.306181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.307821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.307821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.307821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.331195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:08.338842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-afad7c38-85fa-4e96-81cb-6898b3bb4d9e tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.152992 May 31 22:41:08.339714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 433/876] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:08 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:08.415639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:08.416340 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:08.422233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.422772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.423654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:08.424091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:08.440603 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:08.448869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-08a7644c-de69-4936-8e57-c33c8eeb7541 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1682 microversion: 2.1 time: 0.154418 May 31 22:41:08.449440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 444/877] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:08 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:08.552879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:08.560375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d32eafd5-465a-474e-9d49-2a54eba4a892 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.148619 May 31 22:41:08.560974 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 434/878] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:08 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:09.355648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:09.356259 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:09.362727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.363197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.363955 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.364390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.465294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:09.465912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:09.473061 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.473513 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.474289 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.474725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.491186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:09.499520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3bb98c2d-2417-4720-a443-082cb6709d42 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.147705 May 31 22:41:09.500188 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 445/879] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:09 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:09.577386 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:09.578140 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:09.584166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.584704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.585577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:09.586086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:09.605400 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:09.612804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d936047e-9d91-4bc0-b78e-5704ef3c62c3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1682 microversion: 2.1 time: 0.151361 May 31 22:41:09.613368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 435/880] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:09 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:09.715921 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:09.723565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6cee284a-3afe-48a0-b979-2c0f36c10c03 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.150127 May 31 22:41:09.724129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 446/881] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:09 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:10.516227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:10.516838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:10.519273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:10.524463 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.527682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.527682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.527682 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.629572 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:10.630167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:10.637398 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.637844 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.638608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.639066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.654356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:10.661909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ba0d4ac9-5fc4-4356-996c-b0737ea71335 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.149518 May 31 22:41:10.662478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 436/882] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:10 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:10.741008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:10.741621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:10.747689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.748079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.748847 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:10.749288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:10.766055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:10.773528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1988f170-7b50-43ed-8f11-5b43ad898c44 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1682 microversion: 2.1 time: 0.147808 May 31 22:41:10.774606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 447/883] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:10 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:10.881203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:10.889209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f380e1c3-5a8c-4616-995c-e237c056979e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.152153 May 31 22:41:10.889775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 437/884] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:10 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:11.679491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:11.680095 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:11.687233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.690662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.690662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.690662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.791856 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:11.792478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:11.799169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.799653 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.800579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.801013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.817040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:11.824640 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e09d064d-64f1-466f-ba15-7ed1286ad72b tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.149281 May 31 22:41:11.825448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 448/885] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:11 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:11.905873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:11.906476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:11.912390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.912831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.913588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:11.914019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:11.933459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:11.940369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af1485b2-acc0-47ce-a828-2c12dbf78cf4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1682 microversion: 2.1 time: 0.152927 May 31 22:41:11.941049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 438/886] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:11 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:12.048458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:12.056228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-93761d64-d8ba-414e-a0a6-ac460b81c267 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.154231 May 31 22:41:12.056808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 449/887] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:11 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:12.840822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:12.841431 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:12.847904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:12.848347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:12.849104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:12.849534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:12.957522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:12.958913 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:12.965611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:12.966139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:12.967021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:12.967459 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:13.019654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:13.027223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-27511e3d-925d-4967-a725-c4727283d77a tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1520 microversion: 2.1 time: 0.190271 May 31 22:41:13.027824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 439/888] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:12 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:13.072614 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:13.073151 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:13.079784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:13.080236 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:13.081189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:13.081649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:13.114998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:13.123543 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eaf81f43-d91f-44bd-9488-1a6c99487563 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1682 microversion: 2.1 time: 0.169941 May 31 22:41:13.124129 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 450/889] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:12 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:13.351662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:13.360604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b0155536-c1ef-4a08-a034-8423aad3160d tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.291751 May 31 22:41:13.370832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 440/890] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:13 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:13.955787 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-f09f6837-0a28-42ab-a507-5f0a209bdb35 req-aaadc4fe-6004-46a7-89e8-4f4f1f3b5f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea73e6f2-f23d-4bab-9c42-3cd5ae60935d", "name": "network-vif-deleted", "tag": "e01c4000-a281-4a40-86d1-800b7c862941"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:13.964801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-f09f6837-0a28-42ab-a507-5f0a209bdb35 req-aaadc4fe-6004-46a7-89e8-4f4f1f3b5f97 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:13.965402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-f09f6837-0a28-42ab-a507-5f0a209bdb35 req-aaadc4fe-6004-46a7-89e8-4f4f1f3b5f97 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:13.976228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-f09f6837-0a28-42ab-a507-5f0a209bdb35 req-aaadc4fe-6004-46a7-89e8-4f4f1f3b5f97 service nova] Creating event network-vif-deleted:e01c4000-a281-4a40-86d1-800b7c862941 for instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d on hv-cinder-84414 May 31 22:41:13.981262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-f09f6837-0a28-42ab-a507-5f0a209bdb35 req-aaadc4fe-6004-46a7-89e8-4f4f1f3b5f97 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029185 May 31 22:41:13.981936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 451/891] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:14.042923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:14.043542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:14.049874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.050325 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.051119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.051822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.118038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:14.125489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-312da29a-2201-4bd1-8135-dbdd7865b3ad tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1478 microversion: 2.1 time: 0.086456 May 31 22:41:14.126064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 441/892] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:14 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1478 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:14.144412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:14.145109 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:14.152767 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.153211 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.153981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.154415 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.223941 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:14.235045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2c52aa0b-3bb6-4389-89fd-7b8a23e5a8f2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1614 microversion: 2.1 time: 0.094979 May 31 22:41:14.235045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 452/893] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:14 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1614 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:14.379559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:14.380333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:14.387237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.387772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.388597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:14.389244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:14.535927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:14.545895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-179d0fde-1042-46fd-b9b3-042a8cce98cf tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.169898 May 31 22:41:14.554690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 442/894] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:14 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:15.142066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:15.142673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:15.150333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.152921 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.152921 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.152921 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.221282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a5a154e334e49db92d41cefaf75ef27', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dbc9abb548994abba42919b7d850be0b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:15.230596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ecff69f2-b4fe-4d9f-9009-b7041ba07cbd tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 200 len: 1478 microversion: 2.1 time: 0.091997 May 31 22:41:15.230855 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 453/895] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:15 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 1478 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:15.258493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:15.258493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:15.258493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.259171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.259559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.260045 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.327993 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:15.336395 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-45108bf7-9309-401e-a2ff-02c445e67024 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1614 microversion: 2.1 time: 0.090372 May 31 22:41:15.339399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 443/896] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:15 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:15.565663 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:15.566275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:15.572846 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.573294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.574072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:15.574516 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:15.706336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:15.714260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a6ba7ddb-d037-4143-834f-8d2f39e5bdec tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.152624 May 31 22:41:15.718755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 454/897] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:15 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:15.995727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b9554ee8-c1cf-4ca4-ac79-fc8577c7dfaa req-1a068b9d-6c09-4422-94b4-605e08206a67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "045c3d9d-a2aa-4c66-8236-724814eddc25", "name": "network-vif-deleted", "tag": "3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:16.003874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b9554ee8-c1cf-4ca4-ac79-fc8577c7dfaa req-1a068b9d-6c09-4422-94b4-605e08206a67 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.004317 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b9554ee8-c1cf-4ca4-ac79-fc8577c7dfaa req-1a068b9d-6c09-4422-94b4-605e08206a67 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.015615 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b9554ee8-c1cf-4ca4-ac79-fc8577c7dfaa req-1a068b9d-6c09-4422-94b4-605e08206a67 service nova] Creating event network-vif-deleted:3a2d86a9-5c1c-43bc-999a-1a5e837ea4a1 for instance 045c3d9d-a2aa-4c66-8236-724814eddc25 on hv-cinder-84414 May 31 22:41:16.020636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b9554ee8-c1cf-4ca4-ac79-fc8577c7dfaa req-1a068b9d-6c09-4422-94b4-605e08206a67 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029126 May 31 22:41:16.021207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 444/898] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:16.247173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:16.247926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] [instance: ea73e6f2-f23d-4bab-9c42-3cd5ae60935d] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:16.254819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.255535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.256332 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.256773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.271137 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] HTTP exception thrown: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Request method failure captured: May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d HTTP/1.1 May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphEmgsIR1PKebLwbTtBv5_bGKBIdJ1FudIYqAYv6Vl-hTQfQ6sgLA1jR7riu4CBMrTlO6YycpQS0G6A7mBg-mchauL_8g5fI7qA4jCLL7etM7QnSywfyKnssNi5Q5YMi0dsrBZH_HE3JXWt4ID4o9VFrtV4yqyKJLwtFfNUYOTe2FM May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: dbc9abb548994abba42919b7d850be0b May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:41:16.272805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/dbc9abb548994abba42919b7d850be0b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_dbc9abb548994abba42919b7d850be0b"}]}] May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: dbc9abb548994abba42919b7d850be0b May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-815996456 May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 0a5a154e334e49db92d41cefaf75ef27 May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-ServerRescueNegativeTestJSON-815996456-project May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. May 31 22:41:16.274329 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'ea73e6f2-f23d-4bab-9c42-3cd5ae60935d'} May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:41:16.275339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. May 31 22:41:16.277055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:41:16.278443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] Returning 404 to user: Instance ea73e6f2-f23d-4bab-9c42-3cd5ae60935d could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:41:16.278443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0a335226-939e-4c5e-b8c9-b5b286a49797 tempest-ServerRescueNegativeTestJSON-815996456 tempest-ServerRescueNegativeTestJSON-815996456-project] 10.222.0.39 "GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d" status: 404 len: 111 microversion: 2.1 time: 0.031624 May 31 22:41:16.278443 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 455/899] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:16 2022] GET /compute/v2.1/servers/ea73e6f2-f23d-4bab-9c42-3cd5ae60935d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:41:16.355576 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:16.356457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:16.363479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.364054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.364961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.365518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.400663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.401308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.401835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'fault' on Instance uuid 045c3d9d-a2aa-4c66-8236-724814eddc25 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:41:16.455988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:16.464669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5d047027-4db3-4466-8328-a382f79491f7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 200 len: 1331 microversion: 2.1 time: 0.114698 May 31 22:41:16.465341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 445/900] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:16 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:16.732343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:16.732961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:16.739225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.739866 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.740683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.741124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.743962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:16.880368 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:16.888684 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4f7b4ad0-1d9d-474b-9b18-157c868d0a98 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1568 microversion: 2.1 time: 0.161686 May 31 22:41:16.889345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 456/901] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:16 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:16.908899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:16.909534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:16.916002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.916456 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.917453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:16.917902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:16.921883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:17.171060 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d4256aac-4f4b-4a26-b617-40f8fc33e5cd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "POST /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09/action" status: 202 len: 0 microversion: 2.1 time: 0.266107 May 31 22:41:17.171992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 446/902] 10.222.0.39 () {60 vars in 1277 bytes} [Tue May 31 22:41:16 2022] POST /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:41:17.182551 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:17.183521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:17.191445 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:17.192771 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:17.193639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:17.194092 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:17.347548 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:17.356497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-597c8443-7b7c-4b0a-bcb8-a95d7f2290b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1516 microversion: 2.1 time: 0.180248 May 31 22:41:17.357995 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 457/903] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:17 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:17.483704 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:17.484392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:17.491413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:17.491938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:17.493322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:17.493819 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:17.508059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 HTTP/1.1 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:41:17.510409 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:41:17.511791 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '045c3d9d-a2aa-4c66-8236-724814eddc25'} May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:41:17.512528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:41:17.513702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:41:17.514940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:41:17.514940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c924b013-9408-4e2b-aa57-822c1290a35c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 404 len: 111 microversion: 2.1 time: 0.032817 May 31 22:41:17.514940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 447/904] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:17 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:41:17.521152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e10bad5d-dbd1-4f06-95c3-5bbe073cc059 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '.version_select at 0x7ff45e2c4550>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:17.603496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e10bad5d-dbd1-4f06-95c3-5bbe073cc059 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-762140760" status: 202 len: 0 microversion: 2.1 time: 0.086514 May 31 22:41:17.604081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 458/905] 10.222.0.39 () {58 vars in 1217 bytes} [Tue May 31 22:41:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-762140760 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:41:18.380304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:18.380304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:18.392102 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:18.392700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:18.393583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:18.394453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:18.424148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-4a108ee2-8ead-40ee-9f25-3204f8800370 req-36dfa9c7-564e-4de1-9c40-ce23a86446e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "name": "network-vif-unplugged", "status": "completed", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:18.438111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-4a108ee2-8ead-40ee-9f25-3204f8800370 req-36dfa9c7-564e-4de1-9c40-ce23a86446e6 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:18.444346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-4a108ee2-8ead-40ee-9f25-3204f8800370 req-36dfa9c7-564e-4de1-9c40-ce23a86446e6 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:18.458503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.compute.server_external_events [req-4a108ee2-8ead-40ee-9f25-3204f8800370 req-36dfa9c7-564e-4de1-9c40-ce23a86446e6 service nova] Unable to find a host for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09. Dropping event network-vif-unplugged {{(pid=124589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 22:41:18.459657 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-4a108ee2-8ead-40ee-9f25-3204f8800370 req-36dfa9c7-564e-4de1-9c40-ce23a86446e6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.114595 May 31 22:41:18.460725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 448/906] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 116 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 31 22:41:18.612087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5744dfa5-95be-4a45-aa03-889fc640cacc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: .version_select at 0x7ff45dae0a60>, body: {"keypair": {"name": "tempest-keypair-1683281565", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFGrqYowU9cB2ZeBpIxGhUS3oUwXOJknl9jGjiyXX5d/WjUvh8mdkDBjAKlopm/KWuMt3Ne1bzgrzJpUuvq3by+lxDQPyM0do41qU1YMPb4c2TjiUApAs7jVJisrBWCFQ=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:18.628568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-5744dfa5-95be-4a45-aa03-889fc640cacc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:41:18.632813 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-5744dfa5-95be-4a45-aa03-889fc640cacc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:41:18.671267 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:18.680303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f958684f-84c9-4533-9972-aeac69ba76ac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1516 microversion: 2.1 time: 0.309114 May 31 22:41:18.682949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 459/907] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:18 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:18.740399 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5744dfa5-95be-4a45-aa03-889fc640cacc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.132070 May 31 22:41:18.741913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 449/908] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:41:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:19.712835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:19.714124 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:19.726673 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:19.727205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:19.728000 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:19.729470 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:19.886906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:19.895641 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41b8ac60-209e-4b37-b40c-252e71a4e33e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1518 microversion: 2.1 time: 0.197550 May 31 22:41:19.896304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 460/909] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:19 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1518 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:20.914552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:20.923507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:20.923507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:20.923507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:20.924083 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:20.924611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:21.350449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:21.358572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d300e736-6617-4d4c-9b14-250ee5206a17 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.448721 May 31 22:41:21.359179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 450/910] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:20 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:22.083239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1618365723", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "10a18a0f-17f5-48fc-adf9-abe14bc8b4bd"}], "security_groups": [{"name": "tempest-securitygroup--1088445138"}], "key_name": "tempest-keypair-1683281565", "user_data": "}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:22.188025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] validate_networks() for [('10a18a0f-17f5-48fc-adf9-abe14bc8b4bd', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:41:22.375986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:22.376743 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:22.383487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:22.383961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:22.384733 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:22.385169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:22.532855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:22.541232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-78ac75af-fbaf-457f-836f-0e287d9cfd76 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.168728 May 31 22:41:22.541879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 451/911] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:22 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:22.564695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:41:22.565151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:41:22.565630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:41:22.566075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:41:22.566492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:41:22.575447 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:22.575896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:22.576701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:22.577138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:22.593857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:41:22.597763 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Getting quotas for user 944d420c3cce4fc7ab5d64549c12fde3 and project ccb364f76acc4607bd11bea6a1932388. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:41:22.611208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:41:22.613521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:41:22.736588 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d0202e4d-0ce7-4462-890f-c87c56879209 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.657622 May 31 22:41:22.737242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 461/912] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:41:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:41:22.747600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f4f1c22f-1a32-487e-b611-305d99f739d4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:22.748214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f4f1c22f-1a32-487e-b611-305d99f739d4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:22.801639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f4f1c22f-1a32-487e-b611-305d99f739d4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:22.808486 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f4f1c22f-1a32-487e-b611-305d99f739d4 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1242 microversion: 2.1 time: 0.064985 May 31 22:41:22.809052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 452/913] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:22 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:23.559185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:23.559738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:23.566801 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:23.567272 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:23.568056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:23.568497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:23.725174 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:23.733488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e5cbcdb4-5363-44da-9f64-bba7cc96258f tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.178980 May 31 22:41:23.734056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 462/914] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:23 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:23.826171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:23.826739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:23.833332 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:23.833792 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:23.834597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:23.835192 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:23.909233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:23.916788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c7181645-5f59-4d64-90ba-bcd56e97d03e tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1246 microversion: 2.1 time: 0.095176 May 31 22:41:23.917355 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 453/915] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:23 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1246 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:24.750562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:24.751179 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:24.757785 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:24.758240 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:24.759836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:24.760281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:24.933694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:24.935004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:24.935144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:24.943217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:24.943911 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:24.944888 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:24.945192 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ba66855c-94f8-4efe-894f-3c6b8dde3ccd tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.198430 May 31 22:41:24.945747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:24.955364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 463/916] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:24 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:25.030423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:25.038146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e5def46e-2a1c-4ada-bed4-11519d8f25c7 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1302 microversion: 2.1 time: 0.108907 May 31 22:41:25.038825 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 454/917] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:24 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1302 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:25.963960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:25.964685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:25.971548 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:25.972077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:25.972959 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:25.973502 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:26.056770 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:26.057528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:26.064628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:26.065386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:26.066238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:26.066910 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:26.177988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:26.186218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-de539ca5-0647-44a3-8fa5-5ca6509acbd3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.227155 May 31 22:41:26.186819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 464/918] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:25 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:26.259587 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:26.268850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cc49d321-b810-4a3e-9f9e-74c46936c8ff tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.216267 May 31 22:41:26.269437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 455/919] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:26 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:26.557325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-bdf3fed7-77fa-40c0-b8e9-4ea9cf36e8a5 req-a639011a-d7b0-45dc-a105-ba6ad127a171 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1d2d3-a6ae-4512-a402-c970d0a399ca", "tag": "75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:26.584357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bdf3fed7-77fa-40c0-b8e9-4ea9cf36e8a5 req-a639011a-d7b0-45dc-a105-ba6ad127a171 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:26.584944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-bdf3fed7-77fa-40c0-b8e9-4ea9cf36e8a5 req-a639011a-d7b0-45dc-a105-ba6ad127a171 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:26.597115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-bdf3fed7-77fa-40c0-b8e9-4ea9cf36e8a5 req-a639011a-d7b0-45dc-a105-ba6ad127a171 service nova] Creating event network-changed:75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0 for instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca on hv-cinder-84414 May 31 22:41:26.604233 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-bdf3fed7-77fa-40c0-b8e9-4ea9cf36e8a5 req-a639011a-d7b0-45dc-a105-ba6ad127a171 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052318 May 31 22:41:26.605772 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 465/920] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:27.203960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:27.204574 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:27.211123 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:27.212572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:27.212902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:27.213510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:27.286001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:27.286848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:27.293963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:27.294462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:27.295257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:27.295697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:27.382305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:27.391295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4691f6d4-64b3-4f0f-afcc-081cb5ae1e8b tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.191150 May 31 22:41:27.391932 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 456/921] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:27 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:27.446256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:27.454245 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3bbb4f92-c9bf-44b9-91e0-c6e61fd99837 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.172403 May 31 22:41:27.455034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 466/922] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:27 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:28.409401 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:28.409931 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:28.417021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:28.417466 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:28.418293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:28.418722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:28.471795 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:28.472707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:28.479796 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:28.480241 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:28.481003 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:28.481430 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:28.558500 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:28.566305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-923b7feb-6ef4-4383-9cb5-e19514689286 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.160977 May 31 22:41:28.566901 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 457/923] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:28 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:28.615457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:28.622925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-57e6d3ba-3d54-4806-8e0b-9569117b1a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.155104 May 31 22:41:28.623496 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 467/924] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:28 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:29.582717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:29.583964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:29.590415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:29.591067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:29.591838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:29.592270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:29.639262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:29.639867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:29.646618 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:29.647090 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:29.647856 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:29.648286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:29.730269 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:29.738582 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c3434edb-c787-4c5b-8d0a-de84249cd225 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.159572 May 31 22:41:29.739154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 458/925] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:29 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:29.784156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:29.792154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1cb06f7d-0f73-406d-8e32-7a632b9a4bf2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.156788 May 31 22:41:29.792715 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 468/926] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:29 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:30.764192 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:30.764986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:30.772570 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:30.773165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:30.774181 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:30.774722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:30.925392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:30.935568 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-985b20a7-bd0d-4512-b3e7-25933a1660ae tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.182607 May 31 22:41:30.936479 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 459/927] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:30 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:30.944443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:30.944443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:30.949681 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:30.950139 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:30.950979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:30.951421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:31.036994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:31.040608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:31.040608 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:31.045075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:31.045529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:31.046300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:31.046946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:31.070981 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9256a97-1213-4325-9d32-7fb401edc05d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/ips" status: 200 len: 153 microversion: 2.20 time: 0.316420 May 31 22:41:31.071492 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 469/928] 10.222.0.39 () {60 vars in 1288 bytes} [Tue May 31 22:41:30 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/ips => generated 153 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:41:31.095687 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:31.106478 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3ae8df11-a57c-4b36-a292-7a2d8d7f7eeb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.168431 May 31 22:41:31.107231 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 460/929] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:30 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:32.025780 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:32.026418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:32.039049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:32.039652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:32.040260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:32.040695 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:32.123317 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:32.123924 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:32.130534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:32.131012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:32.131776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:32.132806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:32.173769 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:32.182176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-33f5891c-ab30-4752-b8ab-48de29034433 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.160784 May 31 22:41:32.183425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 470/930] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:32 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:32.278382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:32.286029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8fefdd79-053e-4628-805b-4a6df4316154 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.166622 May 31 22:41:32.286561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 461/931] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:32 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:32.521954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-23445a18-7f52-4a95-8afc-9b76394fd7a4 req-f7d0e692-0003-40bb-b457-0c6f80b12b28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "name": "network-vif-plugged", "status": "completed", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:32.530169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-23445a18-7f52-4a95-8afc-9b76394fd7a4 req-f7d0e692-0003-40bb-b457-0c6f80b12b28 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:32.530620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-23445a18-7f52-4a95-8afc-9b76394fd7a4 req-f7d0e692-0003-40bb-b457-0c6f80b12b28 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:32.542023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-23445a18-7f52-4a95-8afc-9b76394fd7a4 req-f7d0e692-0003-40bb-b457-0c6f80b12b28 service nova] Creating event network-vif-plugged:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:41:32.546874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-23445a18-7f52-4a95-8afc-9b76394fd7a4 req-f7d0e692-0003-40bb-b457-0c6f80b12b28 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028944 May 31 22:41:32.547596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 471/932] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:33.186294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:33.188843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:33.188992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:33.194393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.195414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.196203 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.196641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.197231 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:33.197988 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:33.202589 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:33.203320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:33.210254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.212281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.212281 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.212597 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.221483 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lazy-loading 'flavor' on Instance uuid bab62c4a-9ee6-40a9-a8b5-debaa5a233ec {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:41:33.348169 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:33.356235 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2d49bd77-25ad-4688-9544-b29cf185222a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1574 microversion: 2.1 time: 0.159849 May 31 22:41:33.357156 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 472/933] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:33 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:41:33.361954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:33.362676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:33.368731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.369189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.369962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.370399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.514617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:33.522000 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-adc408eb-e9a0-4881-831a-8212c35bd36f tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.163608 May 31 22:41:33.522557 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 473/934] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:33 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:33.755002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-75f4ef08-86e8-4598-b907-f4edfe0d135f tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/action" status: 202 len: 0 microversion: 2.20 time: 0.572653 May 31 22:41:33.764049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 462/935] 10.222.0.39 () {62 vars in 1318 bytes} [Tue May 31 22:41:33 2022] POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/action => generated 0 bytes in 574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 22:41:33.764546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:33.765383 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:33.772599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.773134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.773936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:33.774408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:33.905522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:33.913709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:33.915373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:33.916523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95a9706c-1f33-4f89-8eef-eedac4721b9d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.156175 May 31 22:41:33.917075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 474/936] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:33 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:34.375077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:34.377602 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:34.382066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.382511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.383372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.383832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.387940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:34.540827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:34.541444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:34.548403 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.549182 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.550144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.550584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.633610 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:34.643296 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-03b8fb6c-5abb-4750-9549-fc646f22c82a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1561 microversion: 2.1 time: 0.272903 May 31 22:41:34.643877 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 463/937] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:34 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1561 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:34.658493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-e06baa7a-1924-4176-9557-dbf29acb610d req-1e8315ab-359b-41c2-acc4-8553814f6401 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1d2d3-a6ae-4512-a402-c970d0a399ca", "name": "network-vif-plugged", "status": "completed", "tag": "75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:34.669038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-e06baa7a-1924-4176-9557-dbf29acb610d req-1e8315ab-359b-41c2-acc4-8553814f6401 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.669481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-e06baa7a-1924-4176-9557-dbf29acb610d req-1e8315ab-359b-41c2-acc4-8553814f6401 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.681270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-e06baa7a-1924-4176-9557-dbf29acb610d req-1e8315ab-359b-41c2-acc4-8553814f6401 service nova] Creating event network-vif-plugged:75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0 for instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca on hv-cinder-84414 May 31 22:41:34.687621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-e06baa7a-1924-4176-9557-dbf29acb610d req-1e8315ab-359b-41c2-acc4-8553814f6401 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039283 May 31 22:41:34.688228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 464/938] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:34.713596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:34.723294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2fdb78d3-9642-4b6b-8c57-08e6c8ce4015 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.187051 May 31 22:41:34.723885 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 475/939] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:34 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:34.934964 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:34.936427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:34.943262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.944039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:34.944842 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:34.945282 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:35.141222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:35.147272 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:35.148793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:35.150583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5349507b-ddf2-4e4e-8d64-45e1a24764c7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.219997 May 31 22:41:35.151160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 465/940] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:34 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:35.740831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:35.741450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:35.750088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:35.750088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:35.750088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:35.750401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:35.753100 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=100 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:35.879251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:35.886996 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8ed1007d-7114-4826-adfc-b6e4174c5a49 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.150009 May 31 22:41:35.887559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 476/941] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:35 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:36.169788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:36.170637 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:36.177106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:36.177579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:36.178344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:36.178806 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:36.309128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:36.317320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:36.319041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:36.320371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b0cc176e-214a-49df-9819-2760d9f4dd6e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.155019 May 31 22:41:36.320933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 466/942] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:36 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:36.903832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:36.905635 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:36.911047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:36.911495 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:36.912266 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:36.912704 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:37.053011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:37.061149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-deb4f543-d5a8-49aa-b741-df3b7a42d58a tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1368 microversion: 2.1 time: 0.161078 May 31 22:41:37.061713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 477/943] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:36 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:37.338224 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:37.338863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:37.345329 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:37.345771 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:37.346529 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:37.347001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:37.480353 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:37.488367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:37.489885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:37.491223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-08f1d892-d0d2-4aa4-aa47-cc84a3cfe1d7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.156942 May 31 22:41:37.492341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 467/944] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:37 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:38.077305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:38.077919 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:38.084423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.084877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.085645 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.086082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.213768 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:38.221307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8b1b7d1e-d2a7-4c4e-83a0-74dc12da16bc tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1559 microversion: 2.1 time: 0.147806 May 31 22:41:38.221792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 478/945] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:41:38 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:41:38.237858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:38.238354 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:38.244468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.244916 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.245683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.246118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.321860 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cd89ff19-617e-4138-8d35-d802ee583d22 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087850 May 31 22:41:38.322558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 468/946] 10.222.0.39 () {58 vars in 1274 bytes} [Tue May 31 22:41:38 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:38.509854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:38.510729 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:38.516737 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.517412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.518351 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:38.518985 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:38.653687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:38.662201 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:38.678309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:38.683879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a084513f-bfca-4d28-894c-40b7fbe48540 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.177996 May 31 22:41:38.689427 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 479/947] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:38 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:39.528233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f806ae1a-f54a-416c-89a6-4f0c9881c437 req-0f64ee73-54cb-4189-a04e-de1fb999e9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7d1d2d3-a6ae-4512-a402-c970d0a399ca", "tag": "75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:39.536644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f806ae1a-f54a-416c-89a6-4f0c9881c437 req-0f64ee73-54cb-4189-a04e-de1fb999e9f6 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:39.537090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f806ae1a-f54a-416c-89a6-4f0c9881c437 req-0f64ee73-54cb-4189-a04e-de1fb999e9f6 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:39.548670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f806ae1a-f54a-416c-89a6-4f0c9881c437 req-0f64ee73-54cb-4189-a04e-de1fb999e9f6 service nova] Creating event network-changed:75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0 for instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca on hv-cinder-84414 May 31 22:41:39.553758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f806ae1a-f54a-416c-89a6-4f0c9881c437 req-0f64ee73-54cb-4189-a04e-de1fb999e9f6 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029761 May 31 22:41:39.554363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 469/948] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:39.706101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:39.707347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:39.716304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:39.717198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:39.717977 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:39.718409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:39.884873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:39.897048 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:39.900356 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:39.902572 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8e798dd3-632e-4034-bb2d-15cc3388df3a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.203013 May 31 22:41:39.904396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 480/949] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:39 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:40.922511 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:40.923133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:40.925035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:40.930155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:40.930600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:40.931449 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:40.931883 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:41.059391 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:41.067292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:41.068808 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:41.069958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c534b74a-3717-4ad3-95f1-eadc8a151452 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.152370 May 31 22:41:41.070520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 470/950] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:40 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:42.088311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:42.088920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:42.095590 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:42.096039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:42.096813 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:42.097250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:42.216754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:42.217422 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:42.224952 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:42.225663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:42.226470 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:42.226965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:42.245374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:42.254385 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:42.256232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:42.257356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-accbc6f1-95b6-414a-a0b2-f71f432a75e1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/ips" status: 200 len: 145 microversion: 2.1 time: 0.046301 May 31 22:41:42.257485 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d93428ca-2da9-4592-bd8a-a0f497ddf7b9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.173148 May 31 22:41:42.258013 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 481/951] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:42 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:42.266979 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 471/952] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:41:42 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:43.276989 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:43.277593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:43.284033 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:43.290821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:43.290821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:43.290821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:43.415835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:43.423751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:43.425252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:43.426656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4fb19a6d-814e-4aa0-859a-bfd21d07b3e5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.154055 May 31 22:41:43.427234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 482/953] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:43 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:43.895644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e96b3091-863e-43a1-9d44-fc1f87c6e569"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:43.896635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:43.902954 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:43.903398 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:43.904190 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:43.904621 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:44.445132 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:44.448373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:44.452593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:44.452994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:44.453811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:44.454253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:44.597751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:44.606294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:44.607836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:44.609038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4bc3428d-a7d2-4baa-b6de-47078ecbae0d tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.167819 May 31 22:41:44.609615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 483/954] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:44 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:44.715241 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2ec566dc-8d82-45b2-872b-d276f345bfe3 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.823771 May 31 22:41:44.716106 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 472/955] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:41:43 2022] POST /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 194 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:45.626819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:45.627428 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:45.633933 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:45.634381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:45.635165 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:45.636191 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:45.766031 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:45.773944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:45.775591 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:45.776742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-960f1dbe-e8eb-45c3-b3b5-5d05db127945 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.154035 May 31 22:41:45.777298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 484/956] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:45 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:46.794837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:46.795545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:46.802356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:46.802831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:46.803610 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:46.804051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:46.940337 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:46.948921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:46.950443 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:46.952447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c271e333-5237-4498-90c5-c4ff26a5153a tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.161634 May 31 22:41:46.952447 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 473/957] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:46 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:47.970357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:47.971015 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:47.977647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:47.978097 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:47.979499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:47.979905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:48.107238 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:48.116262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:48.117932 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:48.119255 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d7da69ab-1a8c-47b3-8fc0-b6ef57949d83 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.152817 May 31 22:41:48.119924 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 485/958] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:47 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:49.138454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:49.140197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:49.147695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:49.148489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:49.149437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:49.149879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:49.293652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:49.302093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:49.303662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:49.304835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-929e2132-32ec-43f1-ba24-7a89eb9e1153 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.171252 May 31 22:41:49.305387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 474/959] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:49 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:50.324224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:50.324834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:50.331093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:50.331576 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:50.332347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:50.332786 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:50.468489 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:50.476296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:50.477807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:50.479690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b6b5fc6b-09f0-43a5-85d5-c0b892453c73 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1744 microversion: 2.20 time: 0.159604 May 31 22:41:50.480248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 486/960] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:50 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1744 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:51.498384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:51.499040 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:51.505540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:51.505985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:51.506746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:51.507258 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:51.637113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:51.645787 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:51.647441 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:51.648709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a4836779-0b2a-4a19-95f0-1ec674807f8c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1744 microversion: 2.20 time: 0.154987 May 31 22:41:51.649351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 475/961] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:51 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:41:52.220687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:52.221893 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:52.228524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.228980 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.229748 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.230193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.264073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-55e7c5e2-00bb-45e3-ba78-c2df16b0393c tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047323 May 31 22:41:52.265017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 487/962] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:41:52 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:41:52.275362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:52.276423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:52.282795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.283295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.284070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.284561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.314051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-04390cd3-629f-45ac-b845-14aa5bebdf14 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569" status: 200 len: 194 microversion: 2.1 time: 0.043010 May 31 22:41:52.314693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 476/963] 10.222.0.39 () {58 vars in 1412 bytes} [Tue May 31 22:41:52 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:41:52.667474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:52.668105 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:52.676213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.676725 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.677506 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:52.677942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:52.863969 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:52.874282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:52.876043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:52.878276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2a1748dc-d0e2-4162-93cb-e15b581db6f7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.213904 May 31 22:41:52.895813 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 488/964] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:52 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:53.918420 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:53.918420 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:53.918946 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:53.919432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:53.920849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:53.921123 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:54.042114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cdcb4bb-40be-48e7-9525-1318e9993478"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:54.043252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:54.050757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:54.051530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:54.052522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:54.053125 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:54.089517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:54.100709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:54.104163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:54.108308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ea892704-6668-4731-9fab-8c27c86ef464 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.203964 May 31 22:41:54.109480 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 477/965] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:53 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:41:54.694481 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-0174f6a9-7d1a-4a10-b4e4-4dbbc5117f45 req-f49ee48f-df85-4854-bd7d-42f02b9d8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "name": "network-vif-plugged", "status": "completed", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:41:54.714223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0174f6a9-7d1a-4a10-b4e4-4dbbc5117f45 req-f49ee48f-df85-4854-bd7d-42f02b9d8cd9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:54.719754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-0174f6a9-7d1a-4a10-b4e4-4dbbc5117f45 req-f49ee48f-df85-4854-bd7d-42f02b9d8cd9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:54.757308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-0174f6a9-7d1a-4a10-b4e4-4dbbc5117f45 req-f49ee48f-df85-4854-bd7d-42f02b9d8cd9 service nova] Creating event network-vif-plugged:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:41:54.757308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-0174f6a9-7d1a-4a10-b4e4-4dbbc5117f45 req-f49ee48f-df85-4854-bd7d-42f02b9d8cd9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069563 May 31 22:41:54.758245 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 478/966] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:41:54.967191 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-00f7e81d-a599-48e7-bdb4-fabf97e1a886 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "POST /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.929065 May 31 22:41:54.968069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 489/967] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:41:54 2022] POST /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 194 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:41:55.129553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:55.130572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:55.139175 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:55.139629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:55.142167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:55.143715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:55.306029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:55.314906 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:55.316517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:55.317815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-efd92a31-5d11-4986-a5b5-4085013b5a42 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.193002 May 31 22:41:55.318350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 479/968] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:55 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:56.337700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:56.339143 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:56.346925 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:56.347503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:56.348501 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:56.349213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:56.495777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:56.508026 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:56.509612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:56.511486 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9f61dd0f-044a-49b1-93b6-11bc79292a07 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.178602 May 31 22:41:56.512214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 490/969] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:56 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:57.531593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:57.532382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:57.539367 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:57.539919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:57.540794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:57.541824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:57.690573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:57.699665 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:57.702583 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:57.710748 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1fbe479c-17e6-4d94-a462-65e4659b77c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.177103 May 31 22:41:57.712408 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 480/970] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:57 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:58.730023 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:58.730646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:58.840466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:58.840466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:58.840466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:58.840466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:58.840843 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:41:58.876315 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:58.884295 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:58.885820 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:41:58.887086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-86f42b9f-e5ab-48ad-a7fd-0fbfbf3b5202 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.161402 May 31 22:41:58.887601 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 491/971] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:58 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:41:59.906726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:41:59.906726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:41:59.920404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:59.921026 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:59.922059 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:41:59.922598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:41:59.946536 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:00.102067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:00.130702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:00.132259 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:00.135661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-179c506a-b6f1-43b1-b950-fe7ab345c97c tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.231580 May 31 22:42:00.135661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 481/972] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:41:59 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:01.157905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:01.158520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:01.169687 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:01.170337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:01.172091 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:01.172710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:01.376819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:01.387979 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:01.389701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:01.391423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b350c403-a4f0-47b7-93c7-914e8745b140 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.237631 May 31 22:42:01.403212 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 492/973] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:01 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:02.409957 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:02.410608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:02.418585 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:02.424772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:02.424772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:02.424772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:02.607005 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:02.617098 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:02.619141 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:02.620566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7639280a-4869-42ec-aeeb-69835713d3a0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.214792 May 31 22:42:02.621553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 482/974] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:02 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:03.619654 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:03.620683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:03.623035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=48 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:03.628004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.628458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.629243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.629714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.639314 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:03.639958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:03.646405 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.647091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.648038 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.648834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.661186 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-43290d78-1768-4e86-b107-68921ccea2f2 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045457 May 31 22:42:03.666998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 493/975] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:42:03 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:03.792225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:03.804077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:03.805593 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:03.806813 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-96fafaaf-5337-440e-8661-e1e846af6561 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1739 microversion: 2.20 time: 0.171244 May 31 22:42:03.807624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 483/976] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:03 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1739 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:03.807984 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:03.808464 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:03.815601 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.820727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.820727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.820727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.848770 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c9a0d15e-4b00-4269-82a3-8ff66a4dba8d tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569" status: 200 len: 194 microversion: 2.1 time: 0.045008 May 31 22:42:03.849367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 494/977] 10.222.0.39 () {58 vars in 1412 bytes} [Tue May 31 22:42:03 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:42:03.859754 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:03.860191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:03.866180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.866636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.867468 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:03.867910 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:03.952247 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lazy-loading 'services' on Instance uuid 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:42:04.203002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cfa6d230-eb98-49db-900a-9505aecd2109 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569" status: 202 len: 0 microversion: 2.1 time: 0.346741 May 31 22:42:04.203636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 484/978] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:42:03 2022] DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/e96b3091-863e-43a1-9d44-fc1f87c6e569 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:04.826159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:04.827804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:04.835690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:04.836141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:04.836967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:04.837763 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:04.972381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:04.980441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:04.982000 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:04.983180 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-133f4627-de0c-4fca-bc6b-2d3bd475e97b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1721 microversion: 2.20 time: 0.162871 May 31 22:42:04.983741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 495/979] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:04 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:06.001108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:06.001772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:06.008591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.009041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.009812 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.010249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.143346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:06.151936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:06.153438 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:06.154586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-24f77c57-77f4-47d1-9a17-a19801f69438 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1721 microversion: 2.20 time: 0.157856 May 31 22:42:06.155180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 485/980] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:05 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:06.371058 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:06.371564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:06.377946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.378394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.379172 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.379604 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.408487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-27d26495-9e00-400e-9028-c23e9732d443 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/8cdcb4bb-40be-48e7-9525-1318e9993478" status: 200 len: 194 microversion: 2.1 time: 0.041441 May 31 22:42:06.409055 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 496/981] 10.222.0.39 () {58 vars in 1412 bytes} [Tue May 31 22:42:06 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/8cdcb4bb-40be-48e7-9525-1318e9993478 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:06.418873 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:06.419369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:06.425294 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.426013 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.426797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:06.427232 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:06.507250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lazy-loading 'services' on Instance uuid 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:42:06.731008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-39f05bb4-743d-4404-9ae9-458fe0fb78d4 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/8cdcb4bb-40be-48e7-9525-1318e9993478" status: 202 len: 0 microversion: 2.1 time: 0.315865 May 31 22:42:06.731601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 486/982] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:42:06 2022] DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments/8cdcb4bb-40be-48e7-9525-1318e9993478 => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:07.175123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:07.178019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:07.192146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:07.192753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:07.193525 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:07.193978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:07.334795 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:07.343217 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:07.344717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:07.345859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-20224c55-780c-4592-b0f0-efd25e6c9db0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1721 microversion: 2.20 time: 0.176665 May 31 22:42:07.346532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 497/983] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:07 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:08.365571 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:08.366255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:08.372918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:08.373360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:08.374146 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:08.374573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:08.505837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:08.514163 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:08.516269 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:08.518352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e0d84f43-0de3-4a81-9776-964201725c67 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1664 microversion: 2.20 time: 0.157404 May 31 22:42:08.519520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 487/984] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:08 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:08.536646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a637b388-f391-4967-b459-0b58808b7ae0"}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:08.537700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:08.544585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:08.545028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:08.545788 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:08.546218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:08.561456 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-6155599e-5afd-490a-b457-8c082147d93a req-ed4b6d62-19d6-4d99-abfd-dcd8aefd4205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "name": "network-vif-unplugged", "status": "completed", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:08.571009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6155599e-5afd-490a-b457-8c082147d93a req-ed4b6d62-19d6-4d99-abfd-dcd8aefd4205 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:08.571594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-6155599e-5afd-490a-b457-8c082147d93a req-ed4b6d62-19d6-4d99-abfd-dcd8aefd4205 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:08.588274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.compute.server_external_events [req-6155599e-5afd-490a-b457-8c082147d93a req-ed4b6d62-19d6-4d99-abfd-dcd8aefd4205 service nova] Unable to find a host for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec. Dropping event network-vif-unplugged {{(pid=124589) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 31 22:42:08.588274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-6155599e-5afd-490a-b457-8c082147d93a req-ed4b6d62-19d6-4d99-abfd-dcd8aefd4205 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033604 May 31 22:42:08.589649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 488/985] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 31 22:42:09.155995 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:09.161406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:09.163097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.163545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.164298 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.164747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.194350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-909c38f6-7c60-4cec-a924-ed29e93f2ccc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042337 May 31 22:42:09.195092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 489/986] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:42:09 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 22:42:09.303318 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:09.304255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:09.311128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.311577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.312335 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.312772 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.342952 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-cee98c76-fff8-4315-866d-221c9a89c8a1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044858 May 31 22:42:09.343510 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 490/987] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:42:09 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 31 22:42:09.399752 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:09.400374 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:09.407403 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.407857 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.408624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.409079 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.434124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:42:09.590657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fa20ab13-bb22-40f1-a9a4-3f28ed487284 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.057900 May 31 22:42:09.591253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 498/988] 10.222.0.39 () {62 vars in 1363 bytes} [Tue May 31 22:42:08 2022] POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments => generated 188 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 31 22:42:09.706347 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:09.707439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:09.713834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.718694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.718694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.718694 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.762799 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e9796d12-e0f9-44d6-bfcd-06dcb1fc35d1 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 204 len: 0 microversion: 2.1 time: 0.366619 May 31 22:42:09.763413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 491/989] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:09 2022] DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 31 22:42:09.771780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:09.773275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:09.779586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.780033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.780802 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:09.781240 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:09.913081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:09.920818 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9858d6fc-f48a-400b-89b9-68556891ea32 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1672 microversion: 2.1 time: 0.152966 May 31 22:42:09.921387 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 492/990] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:09 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:10.258631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-7de56d3d-3514-4152-8c02-1a13162e8d85 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments/a637b388-f391-4967-b459-0b58808b7ae0" status: 202 len: 0 microversion: 2.20 time: 0.556390 May 31 22:42:10.259270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 499/991] 10.222.0.39 () {60 vars in 1456 bytes} [Tue May 31 22:42:09 2022] DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments/a637b388-f391-4967-b459-0b58808b7ae0 => generated 0 bytes in 558 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 31 22:42:10.323315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:10.323879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:10.329908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.330351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.331211 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.331641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.575742 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-37230b5b-43df-4f36-a696-e2893b043e59 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/action" status: 202 len: 0 microversion: 2.20 time: 0.256334 May 31 22:42:10.576469 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 493/992] 10.222.0.39 () {62 vars in 1318 bytes} [Tue May 31 22:42:10 2022] POST /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 31 22:42:10.584874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:10.585491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:10.593152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.593713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.594370 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.594829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.726336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:10.735690 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:10.737854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:10.739157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f9997faa-e3e8-4adc-ba7a-015a271f37c2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1672 microversion: 2.20 time: 0.158382 May 31 22:42:10.739903 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 500/993] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:10 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1672 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:10.937617 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:10.938233 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:10.944356 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.944809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.945625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:10.946066 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:10.965222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:11.075528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:11.082863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c983af2-5241-4f51-a58c-2b354bb39f34 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1672 microversion: 2.1 time: 0.149199 May 31 22:42:11.083550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 494/994] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:10 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:11.757453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:11.758065 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:11.764582 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:11.765035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:11.765805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:11.766243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:11.904183 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:11.912453 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:11.914115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:11.915379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-950c8196-c9c4-4ac5-ac70-0593ae8497de tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1672 microversion: 2.20 time: 0.161859 May 31 22:42:11.916193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 501/995] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:11 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:12.100959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:12.102227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:12.104923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:12.112252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:12.112891 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:12.114043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:12.120569 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:12.326829 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:12.333889 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f72bab16-62f6-468b-82ba-1e0ba86947fc tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1672 microversion: 2.1 time: 0.236863 May 31 22:42:12.344064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 495/996] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:12 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1672 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:12.935889 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:12.936614 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:12.949689 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:12.950237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:12.951185 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:12.951802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:13.259035 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b8efef8a-bbd4-402f-ba80-5397b88a74eb req-2ef3aef5-32dc-4f99-99ed-f9176e0b586d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2", "name": "network-vif-deleted", "tag": "dbe9e018-9861-45dd-a2ff-8875ecb84b63"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:13.279002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b8efef8a-bbd4-402f-ba80-5397b88a74eb req-2ef3aef5-32dc-4f99-99ed-f9176e0b586d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:13.279611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b8efef8a-bbd4-402f-ba80-5397b88a74eb req-2ef3aef5-32dc-4f99-99ed-f9176e0b586d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:13.292896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b8efef8a-bbd4-402f-ba80-5397b88a74eb req-2ef3aef5-32dc-4f99-99ed-f9176e0b586d service nova] Creating event network-vif-deleted:dbe9e018-9861-45dd-a2ff-8875ecb84b63 for instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 on hv-cinder-84414 May 31 22:42:13.306578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b8efef8a-bbd4-402f-ba80-5397b88a74eb req-2ef3aef5-32dc-4f99-99ed-f9176e0b586d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048730 May 31 22:42:13.306578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 496/997] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:42:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:42:13.354076 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:13.355487 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:13.366177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:13.367349 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:13.368424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:13.369273 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:13.405802 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:13.409421 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:13.414474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:13.416024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:13.418423 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4e0b3007-174c-4780-9053-cf895b70aad8 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.486978 May 31 22:42:13.419510 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 502/998] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:12 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:13.498678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a1af4f589cb41af9920e04c2130d49f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae8802f7cc3d492db27311ca9c98c124', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:13.518985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5ff9299e-15c8-404f-8e73-bc24650d4859 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 200 len: 1604 microversion: 2.1 time: 0.169906 May 31 22:42:13.528795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 497/999] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:13 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 1604 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:14.437660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:14.438417 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:14.445360 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:14.445805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:14.446566 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:14.447020 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:14.552392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:14.553678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:14.569705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:14.570089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:14.571781 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:14.572646 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:14.610425 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 HTTP/1.1 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:14.613341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:14.614994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2'} May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:14.615912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:14.617459 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:14.627111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:14.627111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a20f3948-1f4e-4125-91f6-feab34bb27bb tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 404 len: 111 microversion: 2.1 time: 0.092355 May 31 22:42:14.627111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 498/1000] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:14 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:14.629660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:14.638565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c9ecff1e-07b0-4cee-8e34-94ba6b4a8d12 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '.version_select at 0x7ff45dd839d0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:14.654378 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:14.658375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:14.663815 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bc61f19d-2999-4aa1-b7c4-70dbde307cb0 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.226428 May 31 22:42:14.663815 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 503/1001] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:14 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:14.763894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c9ecff1e-07b0-4cee-8e34-94ba6b4a8d12 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-92344808" status: 202 len: 0 microversion: 2.1 time: 0.132928 May 31 22:42:14.764498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 499/1002] 10.222.0.39 () {58 vars in 1214 bytes} [Tue May 31 22:42:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-92344808 => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:15.681006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:15.682290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:15.697207 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:15.698709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:15.700973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:15.701874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:15.938093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:15.950832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:15.951442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:15.952821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4d9290f5-19df-45bf-8d21-b9bc69276d64 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.276933 May 31 22:42:15.953953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 504/1003] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:15 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:16.974379 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:16.975011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:16.981702 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:16.982155 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:16.982970 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:16.983413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:17.184872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:17.195417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:17.197785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:17.204043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-adffa9fa-dcee-443e-a2de-9b648b49fc61 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.229983 May 31 22:42:17.204701 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 500/1004] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:16 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:18.224363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:18.225010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:18.232296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.232945 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.233986 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.234609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.327730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:18.328349 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:18.335229 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.335775 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.336765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.337281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.356547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 HTTP/1.1 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:18.359149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.360709 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2'} May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:18.361561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.365044 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.366678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:18.366678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-07ac048c-4485-4f63-992d-730b60bdbfa0 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 404 len: 111 microversion: 2.1 time: 0.040736 May 31 22:42:18.371243 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 501/1005] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:18 2022] DELETE /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 31 22:42:18.376414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:18.377514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:18.384871 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.385816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.387874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:18.388482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:18.407188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 HTTP/1.1 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:18.408714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.410137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2'} May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:18.411004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. May 31 22:42:18.412393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:18.414643 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:18.415743 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3d0a44b4-83a9-4cc5-a9b7-d39eceab0d74 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2" status: 404 len: 111 microversion: 2.1 time: 0.043306 May 31 22:42:18.417320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 502/1006] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:18 2022] GET /compute/v2.1/servers/3f8aa6e7-b17c-4037-a4c7-0ad871aa70b2 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:18.428041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:18.437616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:18.439234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:18.440839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d07b3a70-7636-4fff-b0aa-15a9ff2b5ce3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.220676 May 31 22:42:18.441789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 505/1007] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:18 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:19.463134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:19.463843 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:19.471647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.472382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.473181 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.473601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.628123 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:19.642556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:19.645620 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:19.647094 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-10e757dc-d5c8-4c0c-9f95-0b7455a6c9c3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.187835 May 31 22:42:19.650815 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 503/1008] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:19 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:19.688256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:19.688789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:19.696776 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.697012 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.697782 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.698220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.719120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb HTTP/1.1 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:19.720895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.722526 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '14bc3b11-0b60-4e5e-b594-f60d8c18c7bb'} May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:19.723493 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.725019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:19.726806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:19.726806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-148296a0-981d-4bc2-8368-a6e89c5d8eb7 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 404 len: 111 microversion: 2.1 time: 0.038697 May 31 22:42:19.726806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 506/1009] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:19 2022] DELETE /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:19.731918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:19.732579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] [instance: 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:19.739635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.740096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.740967 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:19.741884 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:19.759444 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] HTTP exception thrown: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Request method failure captured: May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb HTTP/1.1 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphFQ0s2zAxkvzavNQnkFRtE-bx_9nHvZGfx_0GJ6JoGgUxseZJBEHL4PbUc_fwEgmcT0p_8WISeCjN8ACfgJIA5EQS8CiaEqCKYFrSRI0TdcjK4siFms3HHRZvBgO1U1uwx0fXu4Jfj-KmlcivGbyDJZvVB4pWLDwgyG1XpQDwC9rA May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:19.761896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ae8802f7cc3d492db27311ca9c98c124"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ae8802f7cc3d492db27311ca9c98c124"}]}] May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ae8802f7cc3d492db27311ca9c98c124 May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeTestJSON-940693050 May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 0a1af4f589cb41af9920e04c2130d49f May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeTestJSON-940693050-project May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.763686 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '14bc3b11-0b60-4e5e-b594-f60d8c18c7bb'} May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:19.764828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. May 31 22:42:19.766302 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:19.767909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] Returning 404 to user: Instance 14bc3b11-0b60-4e5e-b594-f60d8c18c7bb could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:19.767909 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9025eb66-ec35-4ea9-8855-b95a7d421888 tempest-AttachVolumeTestJSON-940693050 tempest-AttachVolumeTestJSON-940693050-project] 10.222.0.39 "GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb" status: 404 len: 111 microversion: 2.1 time: 0.039946 May 31 22:42:19.768630 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 504/1010] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:19 2022] GET /compute/v2.1/servers/14bc3b11-0b60-4e5e-b594-f60d8c18c7bb => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:20.666836 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:20.668052 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:20.674513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:20.675239 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:20.676444 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:20.677044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:20.905474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:20.918639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:20.920471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:20.921779 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f4594ec9-88af-4e77-b7ad-e68df6956896 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.258923 May 31 22:42:20.922424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 507/1011] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:20 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:21.940424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:21.941659 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:21.950396 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:21.951187 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:21.952361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:21.953031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:22.231766 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:22.242988 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:22.245222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:22.246928 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-626840f1-7422-4527-8127-39ff942f950e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.310391 May 31 22:42:22.249182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 505/1012] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:21 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:23.012006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:23.012612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:23.019381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:23.020073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:23.021121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:23.021798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:23.064221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e2266910-6f15-4918-90da-dd8570f9cf50 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/ips" status: 200 len: 150 microversion: 2.1 time: 0.056052 May 31 22:42:23.065056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 508/1013] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:42:23 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/ips => generated 150 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:42:23.275064 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:23.276414 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:23.288010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:23.288010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:23.288010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:23.288010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:23.545837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:23.555749 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:23.557586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:23.559126 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7c20f7d2-c3b4-4ec4-8ab5-ed902b44787b tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.288003 May 31 22:42:23.559904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 506/1014] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:23 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:24.578320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:24.579017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:24.585883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:24.586374 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:24.587515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:24.587965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:24.773430 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:24.782915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:24.783795 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:24.785009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ecc757bd-88ec-465d-808b-70d7a308bbb7 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.211639 May 31 22:42:24.785525 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 509/1015] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:24 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:24.856717 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18f5fc81-30e2-42e1-8e6d-f32534e76e4b"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:24.857780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:24.864352 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:24.867904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:24.867904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:24.867904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:25.594114 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4efcb470-a5bc-44a3-95a9-1bfc8c69280d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "POST /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.741931 May 31 22:42:25.595244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 507/1016] 10.222.0.39 () {60 vars in 1322 bytes} [Tue May 31 22:42:24 2022] POST /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:25.806628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:25.807752 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:25.814656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:25.815146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:25.815963 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:25.816559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:25.951437 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:25.959616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:25.961132 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:25.962321 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-788f0513-7ccb-4c9d-9e3c-4ad9a6c2fb51 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.162014 May 31 22:42:25.962962 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 510/1017] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:25 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:26.127991 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-af46c1f1-6fb1-4a4e-b4aa-b270112c7be5 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Action: 'create', calling method: .version_select at 0x7ff45dae0160>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1016936526", "metadata": {"Type": "work"}}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:26.776004 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-af46c1f1-6fb1-4a4e-b4aa-b270112c7be5 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.765966 May 31 22:42:26.777020 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 508/1018] 10.222.0.39 () {60 vars in 1155 bytes} [Tue May 31 22:42:26 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 768 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 31 22:42:26.788744 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-25e0994f-23c0-4177-b739-c8b8265d1100 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45e4f78b0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:26.849439 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-25e0994f-23c0-4177-b739-c8b8265d1100 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 200 len: 353 microversion: 2.1 time: 0.064703 May 31 22:42:26.850827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 511/1019] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:26 2022] GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:26.982885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:26.983626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:26.990887 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:26.991334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:26.992104 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:26.992538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:27.126972 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:27.135018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:27.136543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:27.137734 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-31c54389-9608-41ce-9f13-46e34cd59bfd tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.160473 May 31 22:42:27.138482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 509/1020] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:26 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:27.862541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9f05d9e9-5893-4987-9a6e-a724cbf8a4c2 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45eda6550>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:27.910937 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9f05d9e9-5893-4987-9a6e-a724cbf8a4c2 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 200 len: 354 microversion: 2.1 time: 0.052577 May 31 22:42:27.911615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 512/1021] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:27 2022] GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:27.923307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-80ea087e-139d-41a2-a157-6f7d82c8e9ed tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45dc65700>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:27.969334 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-80ea087e-139d-41a2-a157-6f7d82c8e9ed tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 200 len: 354 microversion: 2.1 time: 0.049899 May 31 22:42:27.969899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 510/1022] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:27 2022] GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 354 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:27.986279 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2186591a-afa0-46e3-8d3a-e7f8e91606a5 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45ede2040>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:28.157855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:28.158482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:28.164711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:28.165160 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:28.165929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:28.166368 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:28.318237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:28.326705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:28.328264 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:28.329433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5eaec23c-644f-4ba0-af41-ae4fcdae8b5e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.176694 May 31 22:42:28.329996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 511/1023] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:28 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 31 22:42:28.722073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-b31bacc9-500d-492c-a37e-e057ae7495b8 req-cc8643d8-78fd-4715-9ae8-3b0d2643f1c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "name": "network-vif-plugged", "status": "completed", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:28.730303 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b31bacc9-500d-492c-a37e-e057ae7495b8 req-cc8643d8-78fd-4715-9ae8-3b0d2643f1c3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:28.730746 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-b31bacc9-500d-492c-a37e-e057ae7495b8 req-cc8643d8-78fd-4715-9ae8-3b0d2643f1c3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:28.741881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-b31bacc9-500d-492c-a37e-e057ae7495b8 req-cc8643d8-78fd-4715-9ae8-3b0d2643f1c3 service nova] Creating event network-vif-plugged:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:42:28.747895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-b31bacc9-500d-492c-a37e-e057ae7495b8 req-cc8643d8-78fd-4715-9ae8-3b0d2643f1c3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029505 May 31 22:42:28.749195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 512/1024] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:42:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:42:29.109036 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2186591a-afa0-46e3-8d3a-e7f8e91606a5 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "DELETE /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 202 len: 0 microversion: 2.1 time: 1.127143 May 31 22:42:29.109640 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 513/1025] 10.222.0.39 () {58 vars in 1247 bytes} [Tue May 31 22:42:27 2022] DELETE /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 0 bytes in 1128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:29.118540 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-79cce99b-1a3c-47d9-a629-22545b3e81cc tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45de72b80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:29.172150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-79cce99b-1a3c-47d9-a629-22545b3e81cc tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 200 len: 353 microversion: 2.1 time: 0.057876 May 31 22:42:29.172732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 513/1026] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:29 2022] GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:29.349395 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:29.349927 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:29.360290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:29.360290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:29.360290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:29.360290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:29.485382 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:29.493454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:29.495009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:29.496854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b6d69a95-046c-4145-949b-6abe38da31e9 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.151079 May 31 22:42:29.497593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 514/1027] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:29 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:30.185888 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1453f5dd-6186-4800-a377-9736fb187d29 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Calling method '.version_select at 0x7ff45dd24820>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:30.212527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-1453f5dd-6186-4800-a377-9736fb187d29 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] HTTP exception thrown: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1453f5dd-6186-4800-a377-9736fb187d29 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Request method failure captured: May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a HTTP/1.1 May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpnRil4zcVLOU4DuUmx3JXi_CN4YXvSs8IP6KYcQen57-VauH4q-MZ60pT0dhhds1C3QAqzKbdKaZabeb7QM-DN87cU2n4rDO3wKudlM-4DxvaRicy0SuFQwkee5nkoMnrEMxsw9fRYraCFcFjlmV5GWW9AK00HUhXcOTQhsn2-ikMQ May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 5f33848d229c48d3a17fc6592681b52a May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesGetTestJSON-1703380021 May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:30.215207 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f33848d229c48d3a17fc6592681b52a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/5f33848d229c48d3a17fc6592681b52a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/5f33848d229c48d3a17fc6592681b52a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_5f33848d229c48d3a17fc6592681b52a"}]}] May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesGetTestJSON-1703380021 May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 5f33848d229c48d3a17fc6592681b52a May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesGetTestJSON-1703380021 May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesGetTestJSON-1703380021-project May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 6702ec0bb194495eadc720debedf8369 May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesGetTestJSON-1703380021-project May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '10adb8a5-671d-4957-8160-ca8805d23e4a'} May 31 22:42:30.219959 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. (HTTP 404) (Request-ID: req-d1cfd20e-fcbd-47e9-bebb-eae69e1839e0) May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:30.220918 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi item = cinderclient( May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 31 22:42:30.222458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 31 22:42:30.223838 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1453f5dd-6186-4800-a377-9736fb187d29 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] Returning 404 to user: Volume 10adb8a5-671d-4957-8160-ca8805d23e4a could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1453f5dd-6186-4800-a377-9736fb187d29 tempest-VolumesGetTestJSON-1703380021 tempest-VolumesGetTestJSON-1703380021-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a" status: 404 len: 109 microversion: 2.1 time: 0.035751 May 31 22:42:30.225693 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 514/1028] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:30 2022] GET /compute/v2.1/os-volumes/10adb8a5-671d-4957-8160-ca8805d23e4a => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:30.515258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:30.515876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:30.522258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:30.522705 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:30.523502 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:30.523938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:30.679662 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:30.687754 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:30.689488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:30.691483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3563361d-f613-4849-901d-403f50836aec tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.180190 May 31 22:42:30.692527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 515/1029] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:30 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:31.710081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:31.711169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:31.718410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:31.719030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:31.720095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:31.720904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:31.859068 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:31.867381 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:31.868947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:31.870089 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-29a9a52c-df05-48f9-9438-6042d25c72a5 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1730 microversion: 2.20 time: 0.164411 May 31 22:42:31.870624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 515/1030] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:31 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:32.891065 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:32.892297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:32.898726 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:32.899205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:32.900114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:32.900710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:33.049184 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:33.059219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:33.060227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:33.061490 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0dbfc4f5-0d46-40ad-a750-015a75ab07e1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1717 microversion: 2.20 time: 0.177149 May 31 22:42:33.062107 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 516/1031] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:42:32 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1717 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:42:33.217590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:33.218276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:33.224597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:33.225051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:33.225822 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:33.226281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:33.308196 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'services' on Instance uuid f7d1d2d3-a6ae-4512-a402-c970d0a399ca {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:42:33.555157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-441c9935-c614-47e4-9c44-f5f08f476396 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments/18f5fc81-30e2-42e1-8e6d-f32534e76e4b" status: 202 len: 0 microversion: 2.1 time: 0.341474 May 31 22:42:33.555935 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 516/1032] 10.222.0.39 () {58 vars in 1415 bytes} [Tue May 31 22:42:33 2022] DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments/18f5fc81-30e2-42e1-8e6d-f32534e76e4b => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:33.564225 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:33.565448 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:33.571425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:33.571790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:33.572573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:33.572998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:33.603741 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb0633ec-908e-41c5-b080-1aa6f62219cf tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 May 31 22:42:33.604289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 517/1033] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:42:33 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:34.617197 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:34.618257 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:34.625133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:34.625581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:34.626359 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:34.626816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:34.656606 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7385d51d-4755-4646-8e36-19893dd38ae2 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044227 May 31 22:42:34.657174 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 517/1034] 10.222.0.39 () {58 vars in 1301 bytes} [Tue May 31 22:42:34 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 31 22:42:34.714218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:34.715307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:34.717577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=44 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:34.722529 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:34.723021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:34.723848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:34.724287 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:34.750009 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:42:35.057508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-468c9981-9d0a-4266-8f28-ebc109a4acd3 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 204 len: 0 microversion: 2.1 time: 0.346663 May 31 22:42:35.058028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 518/1035] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:34 2022] DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:42:35.066117 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:35.066900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:35.072837 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:35.073288 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:35.074244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:35.074678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:35.079307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:35.211507 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:35.219499 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-de4a5b14-3e29-4860-b497-b008de76d585 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1683 microversion: 2.1 time: 0.157177 May 31 22:42:35.220156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 518/1036] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:35 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:36.237739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:36.238458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:36.245613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:36.246876 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:36.247646 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:36.248079 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:36.375974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:36.383748 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-97d2e606-00af-4981-b145-4170bebc4442 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1683 microversion: 2.1 time: 0.150193 May 31 22:42:36.384250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 519/1037] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:36 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:37.401457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:37.402095 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:37.410192 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:37.410564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:37.411372 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:37.411809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:37.597253 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:37.604695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8d525d47-e6ed-475e-b46f-23a9739e6deb tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1683 microversion: 2.1 time: 0.207504 May 31 22:42:37.605255 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 519/1038] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:37 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1683 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:37.950717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-860e9d40-1301-49aa-891b-da34cb2a211a req-287f4f9c-3803-4a89-aaec-38d54058fc6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7d1d2d3-a6ae-4512-a402-c970d0a399ca", "name": "network-vif-deleted", "tag": "75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:42:37.960098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-860e9d40-1301-49aa-891b-da34cb2a211a req-287f4f9c-3803-4a89-aaec-38d54058fc6c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:37.960476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-860e9d40-1301-49aa-891b-da34cb2a211a req-287f4f9c-3803-4a89-aaec-38d54058fc6c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:37.972412 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-860e9d40-1301-49aa-891b-da34cb2a211a req-287f4f9c-3803-4a89-aaec-38d54058fc6c service nova] Creating event network-vif-deleted:75e59fcf-04f7-4b68-ae4b-bfb6d2e3c7d0 for instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca on hv-cinder-84414 May 31 22:42:37.977381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-860e9d40-1301-49aa-891b-da34cb2a211a req-287f4f9c-3803-4a89-aaec-38d54058fc6c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031111 May 31 22:42:37.978282 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 520/1039] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:42:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:38.622150 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:38.622753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:38.629547 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:38.629990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:38.630757 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:38.631209 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:38.695077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:38.702919 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7888b2cb-183f-4bec-b807-cbfcefb8f60b tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1615 microversion: 2.1 time: 0.085236 May 31 22:42:38.703504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 520/1040] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:38 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1615 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:39.720861 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:39.721553 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:39.727724 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:39.728252 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:39.729005 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:39.729435 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:39.789571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:39.796829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bd55680f-4719-4c4d-8eea-7c5a65745528 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1615 microversion: 2.1 time: 0.080677 May 31 22:42:39.797389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 521/1041] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:39 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1615 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:40.813392 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:40.814182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:40.820535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:40.820985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:40.821778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:40.822205 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:40.854604 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:40.855084 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:40.855538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lazy-loading 'fault' on Instance uuid f7d1d2d3-a6ae-4512-a402-c970d0a399ca {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:42:40.895861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '944d420c3cce4fc7ab5d64549c12fde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccb364f76acc4607bd11bea6a1932388', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:42:40.903929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3a64de5d-cf6b-4bf0-aa7b-961e1378401c tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 200 len: 1332 microversion: 2.1 time: 0.093795 May 31 22:42:40.904533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 521/1042] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:40 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 1332 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:41.921612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:41.922325 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:41.929558 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:41.930162 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:41.930974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:41.931409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:41.944938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca HTTP/1.1 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:41.946585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:41.948248 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'f7d1d2d3-a6ae-4512-a402-c970d0a399ca'} May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:41.949254 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:41.950926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:41.952269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:41.952269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-498c2e75-94fe-465e-9449-1f1d88f47834 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 404 len: 111 microversion: 2.1 time: 0.030986 May 31 22:42:41.952269 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 522/1043] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:41 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:41.957018 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-858f6afc-d8c4-4fce-930b-f60bea7077dd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '.version_select at 0x7ff45dd244c0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:42.059897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-858f6afc-d8c4-4fce-930b-f60bea7077dd tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683281565" status: 202 len: 0 microversion: 2.1 time: 0.106563 May 31 22:42:42.060517 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 522/1044] 10.222.0.39 () {58 vars in 1220 bytes} [Tue May 31 22:42:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683281565 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:42:46.366579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:46.367159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:46.374207 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:46.374657 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:46.375471 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:46.375911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:46.379930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:46.389594 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca HTTP/1.1 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:46.391166 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.392661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'f7d1d2d3-a6ae-4512-a402-c970d0a399ca'} May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:46.399973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.401424 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:46.402954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:46.402954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-824c0deb-458f-4824-ae94-35285036faac tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 404 len: 111 microversion: 2.1 time: 0.029959 May 31 22:42:46.402954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 523/1045] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:46 2022] DELETE /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:46.403214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:46.403214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: f7d1d2d3-a6ae-4512-a402-c970d0a399ca] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:46.404102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:46.409062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:46.409515 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:46.410297 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:46.410740 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:46.424078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca HTTP/1.1 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:46.426033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.429649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'f7d1d2d3-a6ae-4512-a402-c970d0a399ca'} May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:46.430566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. May 31 22:42:46.432037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:46.433393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance f7d1d2d3-a6ae-4512-a402-c970d0a399ca could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:46.433393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6db6d44a-bd70-47c1-aff6-cb9f9084a097 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca" status: 404 len: 111 microversion: 2.1 time: 0.030342 May 31 22:42:46.433393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 523/1046] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:46 2022] GET /compute/v2.1/servers/f7d1d2d3-a6ae-4512-a402-c970d0a399ca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:47.713454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:47.713954 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:47.722361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.722834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.723620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.724064 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.738056 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 HTTP/1.1 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:47.739789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.741397 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '045c3d9d-a2aa-4c66-8236-724814eddc25'} May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:47.751700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.753175 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.754616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:47.754616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-63ca5e1b-552f-49ba-824a-9ab37c881ac5 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 404 len: 111 microversion: 2.1 time: 0.032044 May 31 22:42:47.754616 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 524/1047] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:47 2022] DELETE /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:47.754897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:47.754897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 045c3d9d-a2aa-4c66-8236-724814eddc25] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:47.758371 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.758824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.759600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.760030 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.773124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 HTTP/1.1 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:47.774625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.776194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '045c3d9d-a2aa-4c66-8236-724814eddc25'} May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:47.776977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. May 31 22:42:47.778206 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.779895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 045c3d9d-a2aa-4c66-8236-724814eddc25 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:47.779895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c4272ec6-de39-4eeb-a71d-48367b7a0a2d tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25" status: 404 len: 111 microversion: 2.1 time: 0.029749 May 31 22:42:47.779895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 524/1048] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:47 2022] GET /compute/v2.1/servers/045c3d9d-a2aa-4c66-8236-724814eddc25 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:47.784863 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:47.785363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:47.792024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.792475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.793243 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.793678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.810048 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 HTTP/1.1 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:47.811634 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.816292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '20693ef7-74d7-4abb-8e36-5390380de3c8'} May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:47.817194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.819171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:47.820733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:47.820733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-97fb500c-e9fe-454d-81e4-2c957c834a35 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 404 len: 111 microversion: 2.1 time: 0.032074 May 31 22:42:47.820733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 525/1049] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:47 2022] DELETE /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:47.822965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:47.823575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: 20693ef7-74d7-4abb-8e36-5390380de3c8] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:47.830022 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.830485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.831411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:47.831851 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:47.845753 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 HTTP/1.1 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:47.847310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.848867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '20693ef7-74d7-4abb-8e36-5390380de3c8'} May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:47.849676 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. May 31 22:42:47.851180 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:47.852629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance 20693ef7-74d7-4abb-8e36-5390380de3c8 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:47.852629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3192de1f-fc07-4fbb-a08d-a719d68059a0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8" status: 404 len: 111 microversion: 2.1 time: 0.031153 May 31 22:42:47.852629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 525/1050] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:47 2022] GET /compute/v2.1/servers/20693ef7-74d7-4abb-8e36-5390380de3c8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:49.158835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:49.159409 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:49.166218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:49.166669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:49.167474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:49.167912 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:49.181990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 HTTP/1.1 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:42:49.183598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.185804 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'c60508e7-6ac1-4814-99ee-6e8d1d4e2057'} May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:49.186685 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.188236 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:42:49.189761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:49.189761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-cb02ecd6-2eaf-4ce2-b569-6dae51b67eef tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 404 len: 111 microversion: 2.1 time: 0.030092 May 31 22:42:49.189761 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 526/1051] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:49 2022] DELETE /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:49.194365 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:49.194996 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] [instance: c60508e7-6ac1-4814-99ee-6e8d1d4e2057] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:42:49.201524 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:49.201997 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:49.202912 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:42:49.203351 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:42:49.218624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] HTTP exception thrown: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Request method failure captured: May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 HTTP/1.1 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpg1Uy1Pvsp2DMyHeJT7r57MNLd7FqT7rajTe9nIR7hWTT11DujMlDrN14ZWyZsn12CiwaeTrWB9urGRcc-FGxBhyGOqQBj59gh98OygPil7Lj2YSDQA32OvIDpuJAptdVyYhNifZexU2gfNONOV8VfcAOjILQ-kzdJqL8Pzpqy8POs May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:42:49.220287 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/ccb364f76acc4607bd11bea6a1932388"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_ccb364f76acc4607bd11bea6a1932388"}]}] May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: ccb364f76acc4607bd11bea6a1932388 May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-233394387 May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 944d420c3cce4fc7ab5d64549c12fde3 May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeNegativeTest-233394387-project May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.221981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'c60508e7-6ac1-4814-99ee-6e8d1d4e2057'} May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:42:49.222944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. May 31 22:42:49.224437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:42:49.225730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] Returning 404 to user: Instance c60508e7-6ac1-4814-99ee-6e8d1d4e2057 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:42:49.225730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c3823556-cd94-4c54-8ff7-7d7feeaae6e0 tempest-AttachVolumeNegativeTest-233394387 tempest-AttachVolumeNegativeTest-233394387-project] 10.222.0.39 "GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057" status: 404 len: 111 microversion: 2.1 time: 0.031383 May 31 22:42:49.225730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 526/1052] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:42:49 2022] GET /compute/v2.1/servers/c60508e7-6ac1-4814-99ee-6e8d1d4e2057 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:42:56.458432 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ebfa92b3-b9ef-4026-b642-790a6f36158a tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45e4a3430>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:56.506155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ebfa92b3-b9ef-4026-b642-790a6f36158a tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/3e585da5-ec52-4dd6-97ca-caf0d47453d2" status: 200 len: 351 microversion: 2.1 time: 0.051375 May 31 22:42:56.506719 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 527/1053] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:56 2022] GET /compute/v2.1/os-volumes/3e585da5-ec52-4dd6-97ca-caf0d47453d2 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:58.121535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c583a348-fc82-4319-8400-c02ddee16447 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45dc79ee0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:58.167821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c583a348-fc82-4319-8400-c02ddee16447 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/9da97977-e61d-48c9-b469-05b156ece8c8" status: 200 len: 350 microversion: 2.1 time: 0.050023 May 31 22:42:58.168384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 527/1054] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:58 2022] GET /compute/v2.1/os-volumes/9da97977-e61d-48c9-b469-05b156ece8c8 => generated 350 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:59.739613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:59.740369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=7 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:59.744213 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb114a40-1e0e-4b4f-93c3-e6f03f2e02d5 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45eda65e0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:59.791170 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb114a40-1e0e-4b4f-93c3-e6f03f2e02d5 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/48b11d1c-f18f-4a47-8cc5-910850017e21" status: 200 len: 351 microversion: 2.1 time: 0.053033 May 31 22:42:59.791827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 528/1055] 10.222.0.39 () {58 vars in 1244 bytes} [Tue May 31 22:42:59 2022] GET /compute/v2.1/os-volumes/48b11d1c-f18f-4a47-8cc5-910850017e21 => generated 351 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:59.801069 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=7 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:59.801893 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=32 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:42:59.805738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3ffb5022-d65a-4af4-beb9-c98e8c1b8adc tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45de72670>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:59.887147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3ffb5022-d65a-4af4-beb9-c98e8c1b8adc tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087317 May 31 22:42:59.887723 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 528/1056] 10.222.0.39 () {58 vars in 1133 bytes} [Tue May 31 22:42:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:42:59.899578 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-460eb423-53df-45fc-8e2c-5173849f45df tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45e567af0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:42:59.985575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-460eb423-53df-45fc-8e2c-5173849f45df tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.089710 May 31 22:42:59.986141 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 529/1057] 10.222.0.39 () {58 vars in 1148 bytes} [Tue May 31 22:42:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:42:59.997798 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-96b0c2e5-ae13-4ab6-948a-fd6c81d86dfe tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45dd1c1f0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.004488 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.005047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:00.017561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:00.017817 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:00.018745 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:00.019532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:00.048832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:43:00.094143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-96b0c2e5-ae13-4ab6-948a-fd6c81d86dfe tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.099499 May 31 22:43:00.094819 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 529/1058] 10.222.0.39 () {58 vars in 1133 bytes} [Tue May 31 22:42:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:00.252565 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-de6d2662-e4e0-466a-b4a4-b033e28621d3 req-8517978e-7643-4a53-b5b4-015bdcb374ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:43:00.263578 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-de6d2662-e4e0-466a-b4a4-b033e28621d3 req-8517978e-7643-4a53-b5b4-015bdcb374ac service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:00.264411 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-de6d2662-e4e0-466a-b4a4-b033e28621d3 req-8517978e-7643-4a53-b5b4-015bdcb374ac service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:00.277227 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-de6d2662-e4e0-466a-b4a4-b033e28621d3 req-8517978e-7643-4a53-b5b4-015bdcb374ac service nova] Creating event network-changed:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:43:00.284567 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-de6d2662-e4e0-466a-b4a4-b033e28621d3 req-8517978e-7643-4a53-b5b4-015bdcb374ac service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181917 May 31 22:43:00.285461 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 530/1059] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:00.306362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-4402002b-8cea-4174-8ddc-7533b03481b9 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45f7e2790>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.353336 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3d278336-025c-4065-b299-98b404dbbf20 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "DELETE /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 204 len: 0 microversion: 2.1 time: 0.352343 May 31 22:43:00.354595 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 530/1060] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:42:59 2022] DELETE /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:43:00.363333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.369625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:00.373004 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:00.374716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:00.375547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:00.376130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:00.406492 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-4402002b-8cea-4174-8ddc-7533b03481b9 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.119226 May 31 22:43:00.407105 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 531/1061] 10.222.0.39 () {58 vars in 1166 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:00.420667 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-63b794fd-418e-4e8c-a59a-abc6943cf549 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45de72b80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.542158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:00.553623 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-55d8cda5-ec61-436d-82b8-c7813fc12e95 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.194390 May 31 22:43:00.555508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 531/1062] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:43:00.672390 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-63b794fd-418e-4e8c-a59a-abc6943cf549 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.255334 May 31 22:43:00.672950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 532/1063] 10.222.0.39 () {58 vars in 1169 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:00.686065 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4ae74171-5aed-47e5-a1dd-7126a16d4e91 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45e4f9280>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.770261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4ae74171-5aed-47e5-a1dd-7126a16d4e91 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088637 May 31 22:43:00.770883 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 532/1064] 10.222.0.39 () {58 vars in 1154 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:43:00.781739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-c25eafdf-9f57-490e-868b-c2976c2f07c2 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45dcfda60>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.870010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-c25eafdf-9f57-490e-868b-c2976c2f07c2 tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.092000 May 31 22:43:00.870611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 533/1065] 10.222.0.39 () {58 vars in 1187 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:00.882853 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3bea1144-1da5-44c8-9a95-5971b790464f tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] Calling method '.version_select at 0x7ff45e4a35e0>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:00.966133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3bea1144-1da5-44c8-9a95-5971b790464f tempest-VolumesTestJSON-1741307448 tempest-VolumesTestJSON-1741307448-project] 10.222.0.39 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087276 May 31 22:43:00.966703 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 533/1066] 10.222.0.39 () {58 vars in 1154 bytes} [Tue May 31 22:43:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:43:01.571830 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:01.572546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:01.578727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:01.579196 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:01.579951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:01.580382 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:01.710493 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:01.719252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7487b4dc-b42a-451c-86d3-193d0553c74c tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.151217 May 31 22:43:01.719819 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 534/1067] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:01 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:02.736950 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:02.737583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:02.743620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:02.744063 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:02.744812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:02.745242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:02.873333 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:02.881311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-78fdce69-da9e-4925-b681-9901cacd4256 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.148656 May 31 22:43:02.881990 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 534/1068] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:02 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:03.898707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:03.904865 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:03.906739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:03.907324 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:03.907990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:03.908430 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:04.095971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:04.103186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-123a6405-c293-4054-adb5-d0ee6bae7ece tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.208264 May 31 22:43:04.105905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 535/1069] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:03 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:05.120871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:05.121402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:05.128010 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:05.128461 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:05.129227 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:05.129664 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:05.260600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:05.268071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-eca92ae4-9273-4830-abf4-fc68403b4ccb tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.151177 May 31 22:43:05.268640 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 535/1070] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:05 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:06.284814 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:06.285410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:06.292065 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:06.293732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:06.293732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:06.293732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:06.423299 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:06.431194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dc0cdd58-c18b-4160-a809-5be6eeac8b9e tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1567 microversion: 2.1 time: 0.150406 May 31 22:43:06.431834 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 536/1071] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:06 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:07.183713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:07.183713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:07.188425 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.188879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.189644 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.190077 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.221071 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95490741-6a77-4c12-a6c9-f386400d59ff tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044434 May 31 22:43:07.221636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 536/1072] 10.222.0.39 () {60 vars in 1342 bytes} [Tue May 31 22:43:07 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:07.281295 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:07.281790 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:07.287715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.288265 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.288904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.289338 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.315055 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:43:07.449561 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:07.450458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:07.456688 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.457139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.457897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.458334 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.527520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:07.535629 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-48ca3161-2907-42c7-9c79-733dfedaf8af tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1382 microversion: 2.1 time: 0.090247 May 31 22:43:07.536187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 537/1073] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:07 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1382 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:43:07.540944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-87d10bea-f2ae-4ff8-ad56-3a5574dde149 req-011fccc6-5936-44da-abd1-6a8c3659fc21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09", "name": "network-vif-deleted", "tag": "29628e77-08ed-4d0c-8035-7fbf2f93fe8d"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:43:07.549139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-87d10bea-f2ae-4ff8-ad56-3a5574dde149 req-011fccc6-5936-44da-abd1-6a8c3659fc21 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.549575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-87d10bea-f2ae-4ff8-ad56-3a5574dde149 req-011fccc6-5936-44da-abd1-6a8c3659fc21 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.562515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-87d10bea-f2ae-4ff8-ad56-3a5574dde149 req-011fccc6-5936-44da-abd1-6a8c3659fc21 service nova] Creating event network-vif-deleted:29628e77-08ed-4d0c-8035-7fbf2f93fe8d for instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 on hv-cinder-84414 May 31 22:43:07.567477 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-87d10bea-f2ae-4ff8-ad56-3a5574dde149 req-011fccc6-5936-44da-abd1-6a8c3659fc21 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030191 May 31 22:43:07.568096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 538/1074] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:07.582096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9d221408-3119-4de0-8e8e-2aa9d47fd2d3 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 204 len: 0 microversion: 2.20 time: 0.304368 May 31 22:43:07.583039 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 537/1075] 10.222.0.39 () {60 vars in 1279 bytes} [Tue May 31 22:43:07 2022] DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 22:43:07.592219 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:07.592908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:07.599145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.599593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.600355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:07.600794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:07.748019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:07.756263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:07.757848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:07.759081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c1d4934b-8520-4fc8-a2ec-eaf6d7e7fec2 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.171602 May 31 22:43:07.759628 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 539/1076] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:07 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:43:08.555663 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:08.559506 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:08.564494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:08.565029 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:08.565938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:08.566369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:08.636765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:08.644474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-25b89d42-f5c9-42ae-b060-8a19cdcebdac tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1219 microversion: 2.1 time: 0.094858 May 31 22:43:08.645341 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 538/1077] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:08 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:08.777946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:08.778620 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:08.785504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:08.785943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:08.786721 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:08.787168 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:08.920110 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:08.928346 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:08.929870 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:08.931127 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bfb3fed3-2b06-4554-b225-475731cd07f4 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1723 microversion: 2.20 time: 0.157151 May 31 22:43:08.931686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 540/1078] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:08 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:43:09.661535 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:09.662137 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:09.668788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:09.669263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:09.670028 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:09.670465 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:09.704060 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:09.704591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:09.705120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lazy-loading 'fault' on Instance uuid f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:43:09.748433 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c53e726c0e241e48a9ae68ba802abfc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d6702a00ff84f5b89028341f38f5e45', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:09.756306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5382a849-bfbc-42ec-9e41-78a38ae7601a tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 200 len: 1224 microversion: 2.1 time: 0.098727 May 31 22:43:09.756981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 539/1079] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:09 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 1224 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:43:09.954410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:09.956579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:09.962359 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:09.962913 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:09.963683 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:09.964118 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:10.038237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:10.050648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:10.052274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b255effa528e4100b288994bedd3c75b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1ec5f36b5e35430da4ab94f98547a8d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:43:10.053807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-298adcca-2207-44a8-8137-4b3f72b2941e tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 200 len: 1656 microversion: 2.20 time: 0.104675 May 31 22:43:10.067714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 541/1080] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:09 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 1656 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 31 22:43:10.115429 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-1ca0b5b6-ce12-4fe0-8af5-d0d73f9ed4b4 req-6369972b-f6c0-4d53-b20a-284fd75410a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bab62c4a-9ee6-40a9-a8b5-debaa5a233ec", "name": "network-vif-deleted", "tag": "6952b9ab-2df6-42c1-bdb0-3a84d99b4766"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:43:10.125660 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1ca0b5b6-ce12-4fe0-8af5-d0d73f9ed4b4 req-6369972b-f6c0-4d53-b20a-284fd75410a5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:10.128176 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1ca0b5b6-ce12-4fe0-8af5-d0d73f9ed4b4 req-6369972b-f6c0-4d53-b20a-284fd75410a5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:10.140194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-1ca0b5b6-ce12-4fe0-8af5-d0d73f9ed4b4 req-6369972b-f6c0-4d53-b20a-284fd75410a5 service nova] Creating event network-vif-deleted:6952b9ab-2df6-42c1-bdb0-3a84d99b4766 for instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec on hv-cinder-84414 May 31 22:43:10.146504 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-1ca0b5b6-ce12-4fe0-8af5-d0d73f9ed4b4 req-6369972b-f6c0-4d53-b20a-284fd75410a5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035340 May 31 22:43:10.156475 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 540/1081] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:43:10.775089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:10.775949 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] [instance: f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:10.783404 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:10.783848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:10.784617 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:10.785046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] HTTP exception thrown: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Request method failure captured: May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 HTTP/1.1 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpiQUBD1mCnumPTnyrljkPPcdKqKM2r2mxQkLNI6KXB8_QmRBV3WreFMUNZZd9S-brObk8sr2NYlKmXArbOiPYVH4MLCX6kysCREOuEYnTuRmO9h9sn8m69DaiS1Ps7830FbcHF87CnGBerWzRXjbVQgqmS6a3oPoeQybZJ4LS_cTtk May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 4d6702a00ff84f5b89028341f38f5e45 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestShelveInstance-41935912 May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:43:10.801901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d6702a00ff84f5b89028341f38f5e45"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/4d6702a00ff84f5b89028341f38f5e45"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/4d6702a00ff84f5b89028341f38f5e45"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_4d6702a00ff84f5b89028341f38f5e45"}]}] May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestShelveInstance-41935912 May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 4d6702a00ff84f5b89028341f38f5e45 May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestShelveInstance-41935912 May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-TestShelveInstance-41935912-project May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 9c53e726c0e241e48a9ae68ba802abfc May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestShelveInstance-41935912-project May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. May 31 22:43:10.803658 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09'} May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:10.804676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. May 31 22:43:10.806218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:10.807600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Returning 404 to user: Instance f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:10.807600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3db50db5-53c9-4af2-8969-06adb323e106 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09" status: 404 len: 111 microversion: 2.1 time: 0.031795 May 31 22:43:10.807600 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 542/1082] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:43:10 2022] GET /compute/v2.1/servers/f3bcd3e8-5a7a-4e42-abb1-6d259ab42d09 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:43:11.074980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:11.076311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:11.085794 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:11.086270 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:11.087073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:11.087516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:11.088902 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9fe2224e-49bf-47c3-b41b-6af65b0d08b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] Calling method '.version_select at 0x7ff45ede8670>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:11.108380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec HTTP/1.1 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:43:11.110306 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:11.111886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'bab62c4a-9ee6-40a9-a8b5-debaa5a233ec'} May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:11.112793 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:11.114251 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:11.115627 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:11.115627 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-616efe5b-ee5c-42d9-9b0b-961348208f45 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 404 len: 111 microversion: 2.20 time: 0.041918 May 31 22:43:11.115817 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 541/1083] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:11 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:43:11.120575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e6a2dd50-6ae3-452b-9799-b4d494055838 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '.version_select at 0x7ff45dcfd5e0>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:11.189568 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9fe2224e-49bf-47c3-b41b-6af65b0d08b3 tempest-TestShelveInstance-41935912 tempest-TestShelveInstance-41935912-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-706992965" status: 202 len: 0 microversion: 2.1 time: 0.106238 May 31 22:43:11.195806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 543/1084] 10.222.0.39 () {58 vars in 1250 bytes} [Tue May 31 22:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-706992965 => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:43:11.218726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e6a2dd50-6ae3-452b-9799-b4d494055838 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-143137891" status: 204 len: 0 microversion: 2.20 time: 0.101492 May 31 22:43:11.222333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 542/1085] 10.222.0.39 () {60 vars in 1258 bytes} [Tue May 31 22:43:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-143137891 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 31 22:43:13.747556 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:13.748053 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:13.754829 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:13.755263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:13.756224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:13.756828 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:13.771851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec HTTP/1.1 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:43:13.773411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.775046 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'bab62c4a-9ee6-40a9-a8b5-debaa5a233ec'} May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:13.776167 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.777682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:13.779789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:13.779789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-615ec711-4ef0-4c4a-95df-09c99e0ccf23 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 404 len: 111 microversion: 2.20 time: 0.031733 May 31 22:43:13.779789 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 544/1086] 10.222.0.39 () {60 vars in 1279 bytes} [Tue May 31 22:43:13 2022] DELETE /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:43:13.784956 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:13.789315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: bab62c4a-9ee6-40a9-a8b5-debaa5a233ec] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:13.792476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:13.792923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:13.793690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:13.794131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:13.807186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec HTTP/1.1 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:43:13.808738 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.810322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'bab62c4a-9ee6-40a9-a8b5-debaa5a233ec'} May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:13.812553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. May 31 22:43:13.814010 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:13.815204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance bab62c4a-9ee6-40a9-a8b5-debaa5a233ec could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:13.815204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b6214980-4b9f-4301-bee1-d69f855089f1 tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec" status: 404 len: 111 microversion: 2.20 time: 0.029737 May 31 22:43:13.815204 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 543/1087] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:13 2022] GET /compute/v2.1/servers/bab62c4a-9ee6-40a9-a8b5-debaa5a233ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:43:15.157619 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:15.166410 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:15.178773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:15.178773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:15.178773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:15.178773 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:15.210931 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb HTTP/1.1 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:43:15.211515 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.213114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '4ae243cf-4ef7-4ec0-8650-54f44d6a84bb'} May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:15.213998 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.215743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:43:15.220841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:15.220841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d4c1ec59-b9f5-4998-9bc0-02fc08b1caae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 404 len: 111 microversion: 2.20 time: 0.063760 May 31 22:43:15.220841 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 545/1088] 10.222.0.39 () {60 vars in 1279 bytes} [Tue May 31 22:43:15 2022] DELETE /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:43:15.225983 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:43:15.226595 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] [instance: 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:43:15.233223 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:15.236228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:15.236228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:43:15.236228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:43:15.248489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] HTTP exception thrown: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Request method failure captured: May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb HTTP/1.1 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilphEEpYzhiNtpt75ydanrjwwtUS0ZBhFpXEwmQ2lbYF3H56i1VAQKbxlrOZzLAusjhJQVXLz488P63Wit4Opw6zLjn1CuMvn-oX79SuO1ywdTTN58Unz49RssDPpUL2eimVNq9PgzjN09IIvZE0SEyghWpkbGtTXbPtbKmkhpUJdpAM May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Openstack-Nova-Api-Version: 2.20 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:43:15.250081 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1ec5f36b5e35430da4ab94f98547a8d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1ec5f36b5e35430da4ab94f98547a8d7"}]}] May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1ec5f36b5e35430da4ab94f98547a8d7 May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-243339509 May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: b255effa528e4100b288994bedd3c75b May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-AttachVolumeShelveTestJSON-243339509-project May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.251616 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '4ae243cf-4ef7-4ec0-8650-54f44d6a84bb'} May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:43:15.252553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. May 31 22:43:15.254189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:43:15.255548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] Returning 404 to user: Instance 4ae243cf-4ef7-4ec0-8650-54f44d6a84bb could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:43:15.255548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8c50b8c4-1f4d-46a8-87b9-6a4eb221a5ae tempest-AttachVolumeShelveTestJSON-243339509 tempest-AttachVolumeShelveTestJSON-243339509-project] 10.222.0.39 "GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb" status: 404 len: 111 microversion: 2.20 time: 0.029467 May 31 22:43:15.255548 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 544/1089] 10.222.0.39 () {60 vars in 1276 bytes} [Tue May 31 22:43:15 2022] GET /compute/v2.1/servers/4ae243cf-4ef7-4ec0-8650-54f44d6a84bb => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 31 22:43:50.139114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:43:50.139639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:43:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:44:31.421094 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:31.421755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:31.426466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1451966716", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "networks": [{"uuid": "92978a0c-a9fc-4d03-ba1e-614dfd6e9d21"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:31.497205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] validate_networks() for [('92978a0c-a9fc-4d03-ba1e-614dfd6e9d21', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:44:32.088731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:44:32.089152 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:44:32.089651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:44:32.090057 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:44:32.090464 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:44:32.099432 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:32.099877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:32.100669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:32.101100 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:32.121138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Getting quotas for project 24a262cbb029483387ce37f77d4713b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:44:32.126452 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Getting quotas for user ae683d5129e848ba90c2d7ec5df43271 and project 24a262cbb029483387ce37f77d4713b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:44:32.137994 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:44:32.140286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:44:32.256224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1603fb9a-2705-4669-aa89-974f66acd4f6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.836817 May 31 22:44:32.257024 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 546/1090] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:44:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:44:32.273987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:32.275956 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:32.280092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ff7313c-5c94-4900-aa71-6a43373109c4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:32.280632 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ff7313c-5c94-4900-aa71-6a43373109c4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:32.346406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ff7313c-5c94-4900-aa71-6a43373109c4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:32.353633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ff7313c-5c94-4900-aa71-6a43373109c4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1214 microversion: 2.1 time: 0.081413 May 31 22:44:32.354201 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 545/1091] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:32 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:33.371766 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:33.372372 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:33.379810 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:33.380253 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:33.381022 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:33.381487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:33.447187 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:33.463498 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-58a42682-f38f-4ded-8779-08e713a2280f tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1218 microversion: 2.1 time: 0.095825 May 31 22:44:33.464659 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 547/1092] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:33 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:34.485445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:34.486063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:34.495276 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:34.495728 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:34.496515 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:34.502811 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:34.563714 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:34.572133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-32fbe25c-e182-4097-a578-db62a3b9b8a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1266 microversion: 2.1 time: 0.090587 May 31 22:44:34.572732 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 546/1093] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:34 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:35.590198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:35.590842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:35.599284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:35.599731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:35.600552 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:35.600972 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:35.742537 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:35.750234 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b051ca36-052e-476a-b41e-2efec1491a79 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.164104 May 31 22:44:35.750798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 548/1094] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:35 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:36.559489 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-87af8174-2147-4c44-96e8-a3a333fdda4b req-23c9e90a-0675-470b-a6da-bb852e35a4b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34f12aeb-e306-48fc-91dc-f5e377b5374f", "tag": "6034766c-c162-4676-9c4f-e82045db46fb"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:36.570422 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-87af8174-2147-4c44-96e8-a3a333fdda4b req-23c9e90a-0675-470b-a6da-bb852e35a4b3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:36.570940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-87af8174-2147-4c44-96e8-a3a333fdda4b req-23c9e90a-0675-470b-a6da-bb852e35a4b3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:36.582942 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-87af8174-2147-4c44-96e8-a3a333fdda4b req-23c9e90a-0675-470b-a6da-bb852e35a4b3 service nova] Creating event network-changed:6034766c-c162-4676-9c4f-e82045db46fb for instance 34f12aeb-e306-48fc-91dc-f5e377b5374f on hv-cinder-84414 May 31 22:44:36.588337 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-87af8174-2147-4c44-96e8-a3a333fdda4b req-23c9e90a-0675-470b-a6da-bb852e35a4b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034306 May 31 22:44:36.588936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 547/1095] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:44:36.773563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:36.773563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:36.775016 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:36.775570 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:36.776426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:36.776878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:36.927199 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:36.934975 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8301777c-2aa8-4c3c-9ddb-66893ea6c7b1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.171917 May 31 22:44:36.935549 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 549/1096] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:36 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:37.952618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:37.953238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:37.960407 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:37.960852 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:37.961635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:37.962053 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:38.093898 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:38.101592 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-8746d2d0-98cd-472d-b60a-6efe17e06876 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.153685 May 31 22:44:38.102406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 548/1097] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:37 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:39.117750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:39.118350 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:39.124851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:39.125294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:39.126043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:39.126474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:39.254974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:39.262868 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-25b5d621-ef13-4444-966d-8a1c20faba40 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.148921 May 31 22:44:39.263373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 550/1098] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:39 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:40.280033 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:40.280636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:40.287603 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:40.288050 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:40.288832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:40.289234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:40.425707 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:40.433096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-309054eb-ca8a-441a-8cff-9c533b1405b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.156956 May 31 22:44:40.433652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 549/1099] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:40 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:41.449509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:41.450040 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:41.456458 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:41.457396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:41.458160 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:41.458575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:41.592093 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:41.599753 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-96795869-319e-4732-9f1d-ee5b6603af09 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.154201 May 31 22:44:41.600323 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 551/1100] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:41 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:42.618019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:42.618586 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:42.621110 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:42.625926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:42.626383 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:42.627182 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:42.627637 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:42.775378 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:42.793850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6d8c550e-5b80-470b-bf5c-af9c9cadb56d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.170776 May 31 22:44:42.793850 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 550/1101] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:42 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:42.897122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-70ee1cda-3feb-4960-96ff-731597441028 req-b3f3238c-ecfd-427a-8140-c7f53773c2b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f12aeb-e306-48fc-91dc-f5e377b5374f", "name": "network-vif-plugged", "status": "completed", "tag": "6034766c-c162-4676-9c4f-e82045db46fb"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:42.900609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:42.901268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:42.906822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-70ee1cda-3feb-4960-96ff-731597441028 req-b3f3238c-ecfd-427a-8140-c7f53773c2b3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:42.907260 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-70ee1cda-3feb-4960-96ff-731597441028 req-b3f3238c-ecfd-427a-8140-c7f53773c2b3 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:42.918528 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-70ee1cda-3feb-4960-96ff-731597441028 req-b3f3238c-ecfd-427a-8140-c7f53773c2b3 service nova] Creating event network-vif-plugged:6034766c-c162-4676-9c4f-e82045db46fb for instance 34f12aeb-e306-48fc-91dc-f5e377b5374f on hv-cinder-84414 May 31 22:44:42.923679 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-70ee1cda-3feb-4960-96ff-731597441028 req-b3f3238c-ecfd-427a-8140-c7f53773c2b3 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 May 31 22:44:42.924246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 552/1102] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:44:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:44:43.802380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:43.803154 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:43.809128 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:43.809562 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:43.810320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:43.810752 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:43.943052 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:43.951067 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-09a07939-3644-48b3-8d26-8614ac90cd2d tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.153708 May 31 22:44:43.951631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 551/1103] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:43 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:44.969596 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:44.970133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:44.978575 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:44.979104 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:44.979874 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:44.980310 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:45.117339 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:45.124794 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-b49fb51d-2567-4704-8d0b-554e42d59c86 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1314 microversion: 2.1 time: 0.160531 May 31 22:44:45.125355 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 553/1104] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:44 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:46.142384 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:46.143237 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:46.150161 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:46.150611 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:46.151416 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:46.151904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:46.289008 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:46.296648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a9daf7a-ee25-44c8-be90-d752388fe7b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1499 microversion: 2.1 time: 0.158225 May 31 22:44:46.297299 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 552/1105] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:46 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1499 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:47.156831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:47.157312 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:47.163869 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:47.164317 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:47.165081 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:47.165516 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:47.190826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:44:47.478647 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-58883314-cbf3-4fe8-9291-c77bfaf463d8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "DELETE /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 204 len: 0 microversion: 2.1 time: 0.325670 May 31 22:44:47.479268 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 554/1106] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:44:47 2022] DELETE /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:44:47.489998 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:47.490719 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:47.497267 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:47.497715 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:47.498477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:47.498992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:47.635006 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:47.643032 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2b07d195-777a-4b7a-a43c-7797df8522ef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1505 microversion: 2.1 time: 0.157756 May 31 22:44:47.643609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 553/1107] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:47 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1505 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:48.662296 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:48.663087 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:48.669577 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:48.670032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:48.670819 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:48.671263 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:48.802771 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:48.810271 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c1452d17-79b9-4509-80c1-925124d2fffd tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1505 microversion: 2.1 time: 0.152886 May 31 22:44:48.810845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 555/1108] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:48 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1505 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:49.444730 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-df73d020-584b-4f30-896d-c876a3cf7202 req-5de3b4f4-0f52-4dee-8298-5ac9f75a2a60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34f12aeb-e306-48fc-91dc-f5e377b5374f", "name": "network-vif-deleted", "tag": "6034766c-c162-4676-9c4f-e82045db46fb"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:49.459007 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-df73d020-584b-4f30-896d-c876a3cf7202 req-5de3b4f4-0f52-4dee-8298-5ac9f75a2a60 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:49.459347 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-df73d020-584b-4f30-896d-c876a3cf7202 req-5de3b4f4-0f52-4dee-8298-5ac9f75a2a60 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:49.473496 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-df73d020-584b-4f30-896d-c876a3cf7202 req-5de3b4f4-0f52-4dee-8298-5ac9f75a2a60 service nova] Creating event network-vif-deleted:6034766c-c162-4676-9c4f-e82045db46fb for instance 34f12aeb-e306-48fc-91dc-f5e377b5374f on hv-cinder-84414 May 31 22:44:49.476880 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-df73d020-584b-4f30-896d-c876a3cf7202 req-5de3b4f4-0f52-4dee-8298-5ac9f75a2a60 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039721 May 31 22:44:49.477482 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 554/1109] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:44:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:44:49.827859 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:49.828560 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:49.834961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:49.835406 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:49.836513 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:49.836946 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:49.873736 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:49.874180 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:49.874622 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lazy-loading 'fault' on Instance uuid 34f12aeb-e306-48fc-91dc-f5e377b5374f {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:44:49.920099 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:49.928463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8e3330c8-5dc9-4cad-bbe4-1bf6ed3050f0 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 200 len: 1304 microversion: 2.1 time: 0.104749 May 31 22:44:49.929539 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 556/1110] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:49 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:50.946296 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:50.947034 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 34f12aeb-e306-48fc-91dc-f5e377b5374f] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:50.953127 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:50.953575 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:50.954345 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:50.954795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:50.970908 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] HTTP exception thrown: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Request method failure captured: May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f HTTP/1.1 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilppN8dHtvXuYL7iQksc-cOSP41_NB0lJeQ9245oj4Ygw2bogiUrOu2LYs5RssnJq76v3Rr8J2y8PjXzxY3fnn8O-s91MTBky5PVYqhI0WnIXbuu6-WZeIO3etRCdnHC-Gy4NFuGX-PYDMOIeC3Zt4xsXSnoCiIT8gkFKV5XL4aRzqE4 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 24a262cbb029483387ce37f77d4713b6 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-VolumesActionsTest-1151610888 May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:44:50.972556 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24a262cbb029483387ce37f77d4713b6"}]}] May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-VolumesActionsTest-1151610888 May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 24a262cbb029483387ce37f77d4713b6 May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-VolumesActionsTest-1151610888 May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-VolumesActionsTest-1151610888-project May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: ae683d5129e848ba90c2d7ec5df43271 May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-VolumesActionsTest-1151610888-project May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. May 31 22:44:50.974191 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '34f12aeb-e306-48fc-91dc-f5e377b5374f'} May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:44:50.976011 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. May 31 22:44:50.977622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:44:50.981286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Returning 404 to user: Instance 34f12aeb-e306-48fc-91dc-f5e377b5374f could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:44:50.981286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-f627ebf2-9ae3-4ab9-9b34-826480055888 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f" status: 404 len: 111 microversion: 2.1 time: 0.032270 May 31 22:44:50.981286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 555/1111] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:50 2022] GET /compute/v2.1/servers/34f12aeb-e306-48fc-91dc-f5e377b5374f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:44:51.075857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-577735514", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452", "networks": [{"uuid": "92978a0c-a9fc-4d03-ba1e-614dfd6e9d21"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:51.130636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] validate_networks() for [('92978a0c-a9fc-4d03-ba1e-614dfd6e9d21', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:44:51.486299 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:44:51.486739 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:44:51.487257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:44:51.487727 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:44:51.488173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:44:51.497013 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:51.497463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:51.498256 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:51.498700 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:51.515468 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Getting quotas for project 24a262cbb029483387ce37f77d4713b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:44:51.519583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Getting quotas for user ae683d5129e848ba90c2d7ec5df43271 and project 24a262cbb029483387ce37f77d4713b6. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:44:51.530812 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:44:51.533013 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:44:51.686021 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-de30d16d-5d06-45c6-90df-079d7f8b09b5 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613907 May 31 22:44:51.686669 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 557/1112] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:44:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:44:51.696514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-925363bb-f8cd-4e29-9ed5-4364d3badec2 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:51.697129 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-925363bb-f8cd-4e29-9ed5-4364d3badec2 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:51.768666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-925363bb-f8cd-4e29-9ed5-4364d3badec2 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:51.776009 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-925363bb-f8cd-4e29-9ed5-4364d3badec2 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1213 microversion: 2.1 time: 0.083348 May 31 22:44:51.779108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 556/1113] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:51 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:52.794184 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9e990d29-62cc-487d-9360-342d0d8d2ed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:52.794842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9e990d29-62cc-487d-9360-342d0d8d2ed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:52.857521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9e990d29-62cc-487d-9360-342d0d8d2ed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:52.864134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9e990d29-62cc-487d-9360-342d0d8d2ed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1213 microversion: 2.1 time: 0.075676 May 31 22:44:52.865197 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 558/1114] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:52 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1213 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:52.876088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-395083535", "imageRef": "570a81d1-b7b6-4c0f-b050-f223a5d0c169", "flavorRef": "452"}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:52.930285 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] validate_networks() for None {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:44:53.210847 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:44:53.211373 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:44:53.211941 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:44:53.212424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:44:53.212913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:44:53.222021 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:53.222477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:53.223315 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:53.224322 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:53.240868 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Getting quotas for project 6b074657375347c680091edfd31ff877. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:44:53.245054 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Getting quotas for user 1044913119734b608419bb1e0028c3f6 and project 6b074657375347c680091edfd31ff877. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:44:53.256458 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:44:53.258902 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='570a81d1-b7b6-4c0f-b050-f223a5d0c169',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:44:53.400162 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-12d1330a-abc5-4df9-ae4f-ba1c400a963d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.527812 May 31 22:44:53.400962 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 557/1115] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:44:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:44:53.414245 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-351a3a82-d4f5-404e-aa2e-e4e4cd2ff320 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:53.415338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-351a3a82-d4f5-404e-aa2e-e4e4cd2ff320 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:53.475304 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-351a3a82-d4f5-404e-aa2e-e4e4cd2ff320 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:53.482527 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-351a3a82-d4f5-404e-aa2e-e4e4cd2ff320 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1214 microversion: 2.1 time: 0.075522 May 31 22:44:53.483132 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 559/1116] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:53 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:53.882951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-74a9b578-4c6a-49f0-b15d-578eed0f6647 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:53.883867 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-74a9b578-4c6a-49f0-b15d-578eed0f6647 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:53.949622 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-74a9b578-4c6a-49f0-b15d-578eed0f6647 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:53.956406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-74a9b578-4c6a-49f0-b15d-578eed0f6647 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1213 microversion: 2.1 time: 0.079064 May 31 22:44:53.956958 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 558/1117] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:53 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:54.499806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:54.500538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:54.507607 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:54.508176 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:54.509001 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:54.509505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:54.571116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:54.579144 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4771b010-6536-4dc5-84c8-91333a7f600c tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1218 microversion: 2.1 time: 0.083146 May 31 22:44:54.579692 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 560/1118] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:54 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:54.974293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:54.974933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:54.982134 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:54.982364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:54.983133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:54.983569 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:55.048305 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:55.061423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0f69234a-0923-46b1-8793-9353743b727b tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1217 microversion: 2.1 time: 0.091185 May 31 22:44:55.062143 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 559/1119] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:54 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1217 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:44:55.596535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:55.597148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:55.603573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:55.604011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:55.604764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:55.605192 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:55.669158 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:55.677483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-baf41be9-fbe5-446e-9725-ebc4778cafb8 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1266 microversion: 2.1 time: 0.084821 May 31 22:44:55.678115 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 561/1120] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:55 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:56.078406 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:56.079065 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:56.085497 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:56.085945 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:56.086716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:56.087179 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:56.191452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:56.199124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ff52f5bd-5a11-4416-9806-9d285b448ce1 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1273 microversion: 2.1 time: 0.124538 May 31 22:44:56.199705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 560/1121] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:56 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1273 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:56.696017 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:56.696546 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:56.703137 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:56.703602 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:56.704408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:56.704839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:56.770035 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:56.779262 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24b979ab-82cf-4794-b8cb-611926c3f8a6 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1272 microversion: 2.1 time: 0.087542 May 31 22:44:56.779845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 562/1122] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:56 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:57.217553 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:57.218323 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:57.224784 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:57.225307 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:57.226147 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:57.226656 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:57.342488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:57.351152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-53c5e18f-8183-4f51-9ebf-c501e41c1108 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1271 microversion: 2.1 time: 0.137438 May 31 22:44:57.351722 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 561/1123] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:57 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1271 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:57.796585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:57.797246 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:57.804499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:57.804944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:57.805755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:57.806193 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:57.939275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:57.949414 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-266cb789-acb4-4744-a35e-3a2bc6a125a2 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.156833 May 31 22:44:57.950076 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 563/1124] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:57 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:58.370426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:58.371234 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:58.378103 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:58.379262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:58.379608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:58.380293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:58.597625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:58.605600 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a7219919-142f-47e2-93f4-b015b216fed9 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.239114 May 31 22:44:58.615457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 562/1125] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:58 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:58.857066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-231e4e2e-80a2-42d8-b9ad-17fecc8ecca5 req-7b8f1b7a-0bfc-45a4-bf9f-b74c0498751b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c44925f9-18be-4522-9e58-aa4b95a45624", "tag": "251c01c9-370a-4f4e-a3f4-76102bda12df"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:44:58.866699 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-231e4e2e-80a2-42d8-b9ad-17fecc8ecca5 req-7b8f1b7a-0bfc-45a4-bf9f-b74c0498751b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:58.867157 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-231e4e2e-80a2-42d8-b9ad-17fecc8ecca5 req-7b8f1b7a-0bfc-45a4-bf9f-b74c0498751b service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:58.879019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-231e4e2e-80a2-42d8-b9ad-17fecc8ecca5 req-7b8f1b7a-0bfc-45a4-bf9f-b74c0498751b service nova] Creating event network-changed:251c01c9-370a-4f4e-a3f4-76102bda12df for instance c44925f9-18be-4522-9e58-aa4b95a45624 on hv-cinder-84414 May 31 22:44:58.885706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-231e4e2e-80a2-42d8-b9ad-17fecc8ecca5 req-7b8f1b7a-0bfc-45a4-bf9f-b74c0498751b service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032769 May 31 22:44:58.887369 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 564/1126] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:44:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:44:58.965925 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:58.967091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:58.973765 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:58.974320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:58.975214 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:58.975899 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:59.251577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:59.263152 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6f9869f3-0439-48f2-be7a-ab24bc6422ff tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.300792 May 31 22:44:59.263672 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 563/1127] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:58 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:44:59.623610 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:44:59.624579 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:44:59.632189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:59.632639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:59.633609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:44:59.634220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:44:59.638465 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:44:59.779155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:44:59.787499 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6f6acfe6-d340-4bf6-87ff-bde6223c3b66 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.168095 May 31 22:44:59.790821 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 565/1128] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:44:59 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:00.279900 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:00.280654 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:00.287171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:00.287712 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:00.288471 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:00.288905 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:00.418092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:00.429310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b545f849-8072-4306-b94b-a4db94615a77 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.150259 May 31 22:45:00.429310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 564/1129] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:00 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:00.805584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:00.806203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:00.813242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:00.813696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:00.814502 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:00.814965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:00.910631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-c7a05ba5-2b3e-4793-8626-63ff5477e669 req-01d3b045-97c2-40f3-ac58-3953dcebfaf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c8836ad-b23e-4714-957c-79e64a1667c2", "tag": "f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:00.919188 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c7a05ba5-2b3e-4793-8626-63ff5477e669 req-01d3b045-97c2-40f3-ac58-3953dcebfaf5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:00.919641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-c7a05ba5-2b3e-4793-8626-63ff5477e669 req-01d3b045-97c2-40f3-ac58-3953dcebfaf5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:00.932031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-c7a05ba5-2b3e-4793-8626-63ff5477e669 req-01d3b045-97c2-40f3-ac58-3953dcebfaf5 service nova] Creating event network-changed:f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec for instance 3c8836ad-b23e-4714-957c-79e64a1667c2 on hv-cinder-84414 May 31 22:45:00.936969 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-c7a05ba5-2b3e-4793-8626-63ff5477e669 req-01d3b045-97c2-40f3-ac58-3953dcebfaf5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030120 May 31 22:45:00.937563 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 565/1130] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:45:00.955714 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:00.963743 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-77fe099f-ee1d-4826-be96-d446e2a840b6 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.162602 May 31 22:45:00.964311 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 566/1131] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:00 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:01.445199 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:01.445895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:01.452076 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:01.452523 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:01.453284 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:01.453720 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:01.579093 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:01.587158 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7edab077-21cc-4bed-a93c-4d62bd6e9b11 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.147257 May 31 22:45:01.587729 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 566/1132] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:01 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:01.980585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:01.981155 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:01.983051 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:01.984177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:01.988934 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:01.989387 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:01.990164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:01.990606 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:02.121832 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:02.129292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-23b9cfb1-6bf8-42fb-a301-5b29355c433c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.152709 May 31 22:45:02.130522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 567/1133] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:01 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:02.608947 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:02.609476 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:02.616001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:02.616445 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:02.617285 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:02.617726 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:02.746534 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:02.750102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=100 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:02.754410 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d202627c-66ea-4c8b-a018-beae0de62124 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.149390 May 31 22:45:02.754960 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 567/1134] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:02 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:03.146851 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:03.147390 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:03.153923 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:03.154376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:03.155170 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:03.155612 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:03.283145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:03.290535 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-42084174-392a-4b03-8feb-5a37c04af7a4 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.148289 May 31 22:45:03.291217 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 568/1135] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:03 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:03.772133 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:03.772760 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:03.774627 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:03.780200 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:03.780598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:03.781363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:03.781881 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:03.917157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:03.924985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e635cfc9-22cf-42c8-9fbe-798c8e03c6b0 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.157816 May 31 22:45:03.925558 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 568/1136] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:03 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:04.306964 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:04.307576 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:04.309507 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=10 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:04.314826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:04.315275 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:04.316034 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:04.316473 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:04.443476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:04.450888 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0ef212eb-648f-46ba-b034-c2e862d8e84c tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.147813 May 31 22:45:04.451451 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 569/1137] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:04 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:04.941690 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:04.942346 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:04.944177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=10 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:04.949461 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:04.949915 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:04.950694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:04.951167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:05.010360 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-6bc88692-b770-40ef-8b82-394fdf3a8d6a req-8825fb87-0146-4ae8-bacc-a517def39211 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8836ad-b23e-4714-957c-79e64a1667c2", "name": "network-vif-plugged", "status": "completed", "tag": "f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:05.019006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-6bc88692-b770-40ef-8b82-394fdf3a8d6a req-8825fb87-0146-4ae8-bacc-a517def39211 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:05.023257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-6bc88692-b770-40ef-8b82-394fdf3a8d6a req-8825fb87-0146-4ae8-bacc-a517def39211 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:05.031274 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-6bc88692-b770-40ef-8b82-394fdf3a8d6a req-8825fb87-0146-4ae8-bacc-a517def39211 service nova] Creating event network-vif-plugged:f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec for instance 3c8836ad-b23e-4714-957c-79e64a1667c2 on hv-cinder-84414 May 31 22:45:05.036177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-6bc88692-b770-40ef-8b82-394fdf3a8d6a req-8825fb87-0146-4ae8-bacc-a517def39211 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030916 May 31 22:45:05.037025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 570/1138] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:45:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:45:05.087262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:05.094591 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-96fd2d2d-129e-494f-aa27-6be876cd7dca tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.156900 May 31 22:45:05.095183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 569/1139] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:04 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:05.469289 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:05.470242 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:05.477104 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:05.477559 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:05.478389 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:05.478852 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:05.610682 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:05.622571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9b6ad10c-d777-4551-a60a-453138ea1eef tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.153753 May 31 22:45:05.622571 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 571/1140] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:05 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:06.111369 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:06.111982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:06.118954 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:06.119404 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:06.120169 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:06.120608 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:06.245543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:06.253263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-1b6cff5a-237c-417d-9093-a35f9c2a6169 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.145617 May 31 22:45:06.253824 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 570/1141] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:06 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:06.635146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:06.635764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:06.642261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:06.642717 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:06.643519 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:06.643960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:06.769565 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:06.776860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-1fba3f5e-5229-4574-81cc-2e90ba6403f8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1313 microversion: 2.1 time: 0.145615 May 31 22:45:06.777422 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 572/1142] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:06 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1313 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:07.050933 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-cefa60ac-7391-47a9-b11a-3d6cdeed71a8 req-a86758ca-840b-41bc-b421-f2c75a3f28e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44925f9-18be-4522-9e58-aa4b95a45624", "name": "network-vif-plugged", "status": "completed", "tag": "251c01c9-370a-4f4e-a3f4-76102bda12df"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:07.059835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-cefa60ac-7391-47a9-b11a-3d6cdeed71a8 req-a86758ca-840b-41bc-b421-f2c75a3f28e5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:07.060274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-cefa60ac-7391-47a9-b11a-3d6cdeed71a8 req-a86758ca-840b-41bc-b421-f2c75a3f28e5 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:07.073370 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-cefa60ac-7391-47a9-b11a-3d6cdeed71a8 req-a86758ca-840b-41bc-b421-f2c75a3f28e5 service nova] Creating event network-vif-plugged:251c01c9-370a-4f4e-a3f4-76102bda12df for instance c44925f9-18be-4522-9e58-aa4b95a45624 on hv-cinder-84414 May 31 22:45:07.078860 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-cefa60ac-7391-47a9-b11a-3d6cdeed71a8 req-a86758ca-840b-41bc-b421-f2c75a3f28e5 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031963 May 31 22:45:07.079744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 571/1143] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:45:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:45:07.269835 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:07.270454 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:07.276598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:07.279086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:07.279086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:07.279086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:07.410618 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:07.418928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-96c987d6-8e40-45ec-8095-cc47784a7a15 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.152961 May 31 22:45:07.419503 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 573/1144] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:07 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:07.794588 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:07.795327 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:07.802210 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:07.802662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:07.803527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:07.803971 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:07.930982 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:07.938466 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0c0ff382-8b2d-4492-a278-7572ce397d45 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1497 microversion: 2.1 time: 0.148180 May 31 22:45:07.939062 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 572/1145] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:07 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:08.435860 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:08.436476 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:08.442871 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:08.443318 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:08.444706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:08.445146 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:08.569824 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:08.578396 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-117cf00a-7cd6-4260-b165-35799965c14b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1314 microversion: 2.1 time: 0.146323 May 31 22:45:08.583573 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 574/1146] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:08 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:08.630263 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:08.630901 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:08.633183 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:08.637927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:08.638370 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:08.639267 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:08.639698 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:08.664744 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:45:09.024835 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-a64e8983-7d28-4154-a62d-07415ed65699 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "DELETE /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 204 len: 0 microversion: 2.1 time: 0.398091 May 31 22:45:09.025538 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 573/1147] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:45:08 2022] DELETE /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:45:09.033472 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:09.034130 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:09.040750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.041189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.041941 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.042373 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.168710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:09.176522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4b33b27d-a0ef-43f9-ab28-c3ab5f2ca1ca tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1503 microversion: 2.1 time: 0.146879 May 31 22:45:09.177089 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 575/1148] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:09 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:09.597942 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:09.598635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:09.604636 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.605077 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.605831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.606262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.732727 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:09.740186 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9bea0271-42c1-4646-af77-5b50eb871748 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1464 microversion: 2.1 time: 0.146532 May 31 22:45:09.741262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 574/1149] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:09 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1464 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:09.778675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:09.779201 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:09.785583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.786030 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.786808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:09.787319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:09.812214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:45:10.169230 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ab2bb630-406b-4e2a-9e05-c10b44a76509 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "DELETE /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 204 len: 0 microversion: 2.1 time: 0.394047 May 31 22:45:10.169845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 576/1150] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:45:09 2022] DELETE /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:45:10.178230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:10.183816 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:10.185628 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:10.186074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:10.186975 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:10.187300 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:10.195710 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:10.196533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:10.202530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:10.203032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:10.203803 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:10.204237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:10.324485 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:10.332050 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7e75a8a0-67c4-40fe-85e8-0d9ff8f207c1 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1470 microversion: 2.1 time: 0.157672 May 31 22:45:10.337469 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:10.340831 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 575/1151] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:10 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1470 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:10.345028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-c41c0279-4b5f-4950-ac51-e091a02fe987 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1503 microversion: 2.1 time: 0.155393 May 31 22:45:10.345581 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 577/1152] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:10 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:45:11.350389 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:11.351027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:11.357716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:11.358168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:11.358980 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:11.359438 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:11.361170 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:11.361792 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:11.368676 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:11.369116 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:11.369875 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:11.370301 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:11.489417 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:11.496661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:11.498303 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-effc453a-c928-46bb-ac27-be5d1798317d tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1470 microversion: 2.1 time: 0.151817 May 31 22:45:11.498907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 576/1153] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:11 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1470 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:11.504111 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8a5178b6-d0ec-4c96-aba1-3b22b74aa931 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1503 microversion: 2.1 time: 0.146685 May 31 22:45:11.504665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 578/1154] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:11 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:45:12.520388 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:12.521069 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:12.524924 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:12.525644 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:12.532147 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:12.532564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:12.532798 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:12.533228 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:12.533342 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:12.533776 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:12.534268 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:12.534809 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:12.602651 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:12.613159 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-e4ccb8ee-1923-4ece-9b45-cc228bdcdc8e tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1461 microversion: 2.1 time: 0.096379 May 31 22:45:12.613757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 579/1155] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:12 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1461 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:12.732576 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-9fc10988-a960-4602-989b-a4d98a4b1967 req-e3674b85-2600-4ec4-9d63-5991e66f1b03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c8836ad-b23e-4714-957c-79e64a1667c2", "name": "network-vif-deleted", "tag": "f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:12.741278 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9fc10988-a960-4602-989b-a4d98a4b1967 req-e3674b85-2600-4ec4-9d63-5991e66f1b03 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:12.742011 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-9fc10988-a960-4602-989b-a4d98a4b1967 req-e3674b85-2600-4ec4-9d63-5991e66f1b03 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:12.759626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-9fc10988-a960-4602-989b-a4d98a4b1967 req-e3674b85-2600-4ec4-9d63-5991e66f1b03 service nova] Creating event network-vif-deleted:f58e7379-b7c9-4fad-a4d2-e0f8c6ba2bec for instance 3c8836ad-b23e-4714-957c-79e64a1667c2 on hv-cinder-84414 May 31 22:45:12.765135 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-9fc10988-a960-4602-989b-a4d98a4b1967 req-e3674b85-2600-4ec4-9d63-5991e66f1b03 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036132 May 31 22:45:12.766037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 580/1156] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:45:12.807990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:12.817177 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6d9bff69-8cd0-4f43-8cff-c5f12a416a56 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1470 microversion: 2.1 time: 0.305586 May 31 22:45:12.817961 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 577/1157] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:12 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1470 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:13.631750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:13.633073 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:13.639307 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.639757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.640520 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.640953 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.658703 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:13.671895 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.672338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.673042 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lazy-loading 'fault' on Instance uuid 3c8836ad-b23e-4714-957c-79e64a1667c2 {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:45:13.715980 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae683d5129e848ba90c2d7ec5df43271', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24a262cbb029483387ce37f77d4713b6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:13.725518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-bcfecdce-cecc-41a6-815b-4eca542c4eba tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 200 len: 1303 microversion: 2.1 time: 0.096829 May 31 22:45:13.725518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 581/1158] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:13 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:13.834872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:13.835518 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:13.841634 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.842085 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.842878 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.843321 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.874168 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:13.874618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:13.875092 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lazy-loading 'fault' on Instance uuid c44925f9-18be-4522-9e58-aa4b95a45624 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:45:13.918303 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1044913119734b608419bb1e0028c3f6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b074657375347c680091edfd31ff877', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:13.928711 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6a108fc7-87cc-46c0-8c4d-093b198cf6b5 tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 200 len: 1304 microversion: 2.1 time: 0.097046 May 31 22:45:13.931839 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 578/1159] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:13 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:45:14.741881 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:14.744504 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] [instance: 3c8836ad-b23e-4714-957c-79e64a1667c2] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:14.749379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:14.749826 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:14.750593 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:14.751063 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:14.764446 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] HTTP exception thrown: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Request method failure captured: May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 HTTP/1.1 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilppN8dHtvXuYL7iQksc-cOSP41_NB0lJeQ9245oj4Ygw2bogiUrOu2LYs5RssnJq76v3Rr8J2y8PjXzxY3fnn8O-s91MTBky5PVYqhI0WnIXbuu6-WZeIO3etRCdnHC-Gy4NFuGX-PYDMOIeC3Zt4xsXSnoCiIT8gkFKV5XL4aRzqE4 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 24a262cbb029483387ce37f77d4713b6 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesActionsTest-1151610888 May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:45:14.766082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/24a262cbb029483387ce37f77d4713b6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_24a262cbb029483387ce37f77d4713b6"}]}] May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesActionsTest-1151610888 May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 24a262cbb029483387ce37f77d4713b6 May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesActionsTest-1151610888 May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesActionsTest-1151610888-project May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: ae683d5129e848ba90c2d7ec5df43271 May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesActionsTest-1151610888-project May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. May 31 22:45:14.771976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '3c8836ad-b23e-4714-957c-79e64a1667c2'} May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:45:14.773530 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. May 31 22:45:14.774947 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.776358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] Returning 404 to user: Instance 3c8836ad-b23e-4714-957c-79e64a1667c2 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:45:14.776358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d74d31bb-d068-4595-bb84-03cc263ad2b8 tempest-VolumesActionsTest-1151610888 tempest-VolumesActionsTest-1151610888-project] 10.222.0.39 "GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2" status: 404 len: 111 microversion: 2.1 time: 0.029996 May 31 22:45:14.776358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 582/1160] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:14 2022] GET /compute/v2.1/servers/3c8836ad-b23e-4714-957c-79e64a1667c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:45:14.782274 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-eb6aaaad-8004-4ed7-94b9-c0914a7a6c52 req-bf83ec54-4fd0-4211-be89-4e4a43e1c18f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c44925f9-18be-4522-9e58-aa4b95a45624", "name": "network-vif-deleted", "tag": "251c01c9-370a-4f4e-a3f4-76102bda12df"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:14.790494 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-eb6aaaad-8004-4ed7-94b9-c0914a7a6c52 req-bf83ec54-4fd0-4211-be89-4e4a43e1c18f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:14.790992 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-eb6aaaad-8004-4ed7-94b9-c0914a7a6c52 req-bf83ec54-4fd0-4211-be89-4e4a43e1c18f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:14.802542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-eb6aaaad-8004-4ed7-94b9-c0914a7a6c52 req-bf83ec54-4fd0-4211-be89-4e4a43e1c18f service nova] Creating event network-vif-deleted:251c01c9-370a-4f4e-a3f4-76102bda12df for instance c44925f9-18be-4522-9e58-aa4b95a45624 on hv-cinder-84414 May 31 22:45:14.808190 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-eb6aaaad-8004-4ed7-94b9-c0914a7a6c52 req-bf83ec54-4fd0-4211-be89-4e4a43e1c18f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029626 May 31 22:45:14.808797 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 579/1161] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:45:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:45:14.946257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:14.946917 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] [instance: c44925f9-18be-4522-9e58-aa4b95a45624] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:14.953257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:14.958709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:14.958709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:14.958709 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:14.968501 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] HTTP exception thrown: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Request method failure captured: May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 HTTP/1.1 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilppiXU4PfPR5aDh58zdTC9W-Y8JaXoT5j4r907JW2tS7jo2aCSpG0r-QKGMlikv1gpsQkWTiPfzrkwCR4zhgCOf0uPvWVjXicwt9wb2nDSYWiPjylcwZ9du94kFhJkW4UxOnxOKM-uHGL2lLWiJr2wDynO1yBZ9mJqzq6fJiVQQEHJE May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 6b074657375347c680091edfd31ff877 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-VolumesNegativeTest-1145716163 May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:45:14.969960 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6b074657375347c680091edfd31ff877"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/6b074657375347c680091edfd31ff877"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/6b074657375347c680091edfd31ff877"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_6b074657375347c680091edfd31ff877"}]}] May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-VolumesNegativeTest-1145716163 May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 6b074657375347c680091edfd31ff877 May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-VolumesNegativeTest-1145716163 May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-VolumesNegativeTest-1145716163-project May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 1044913119734b608419bb1e0028c3f6 May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-VolumesNegativeTest-1145716163-project May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. May 31 22:45:14.971648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'c44925f9-18be-4522-9e58-aa4b95a45624'} May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:45:14.972540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. May 31 22:45:14.973777 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:45:14.974942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] Returning 404 to user: Instance c44925f9-18be-4522-9e58-aa4b95a45624 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:45:14.974942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-fb51965b-c9a1-46b8-a38b-79d936ad104b tempest-VolumesNegativeTest-1145716163 tempest-VolumesNegativeTest-1145716163-project] 10.222.0.39 "GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624" status: 404 len: 111 microversion: 2.1 time: 0.030153 May 31 22:45:14.974942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 583/1162] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:14 2022] GET /compute/v2.1/servers/c44925f9-18be-4522-9e58-aa4b95a45624 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:45:35.623967 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:45:35.624890 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:45:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:45:37.229278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:37.230032 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:37.474266 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-70287fc0-c5fb-45f5-91bb-21a993791d85 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Action: 'create', calling method: .version_select at 0x7ff45de72a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-221896076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyXiNiv2/4zpfEEg9/3exb26CbkC5QEjnff/awhWAwJvDQX5r2suIerAQhhnLheaGX8QJcb7FNBpO4KuNlBW5lO3v7JNI6ZyBsm4CI1HOBhQ5KCh/yyFCYwAoaJ+Kuxew=="}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:37.490764 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-70287fc0-c5fb-45f5-91bb-21a993791d85 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:45:37.495669 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-70287fc0-c5fb-45f5-91bb-21a993791d85 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for user 8679b2fd35d0460993b736ef49f44ef6 and project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'key_pairs'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:45:37.573954 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-70287fc0-c5fb-45f5-91bb-21a993791d85 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.346519 May 31 22:45:37.574662 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 580/1163] 10.222.0.39 () {60 vars in 1158 bytes} [Tue May 31 22:45:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:45:58.174482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-349138645", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-221896076", "security_groups": [{"name": "tempest-secgroup-smoke-1894243602"}], "block_device_mapping_v2": [{"uuid": "f11fdf8d-ec5c-4cc9-b06e-a6dc78c4e1c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341538fb-e84e-4c05-a9e7-53b26bd532d0"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:45:58.183450 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:58.435636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] validate_networks() for [('341538fb-e84e-4c05-a9e7-53b26bd532d0', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:45:58.893586 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:45:58.894006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:45:58.894474 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:45:58.894920 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:45:58.895442 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:45:58.905290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:58.905728 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:58.906541 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:45:58.906999 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:45:58.923563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:45:58.927440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for user 8679b2fd35d0460993b736ef49f44ef6 and project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:45:58.982400 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:45:58.989905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f11fdf8d-ec5c-4cc9-b06e-a6dc78c4e1c2',volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:45:59.381707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-87d503ed-812d-40ef-b8d4-b40cd4b78003 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.211243 May 31 22:45:59.386827 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 584/1164] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:45:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 1213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:45:59.390148 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=4 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:59.390929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:45:59.394976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e74f345d-f82a-4c42-ace5-b408dd4e1d50 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:45:59.395731 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e74f345d-f82a-4c42-ace5-b408dd4e1d50 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:45:59.505886 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e74f345d-f82a-4c42-ace5-b408dd4e1d50 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:45:59.513189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e74f345d-f82a-4c42-ace5-b408dd4e1d50 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1093 microversion: 2.1 time: 0.124345 May 31 22:45:59.513849 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 581/1165] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:45:59 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1093 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:46:00.530232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:00.530772 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:00.537992 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:00.538441 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:00.539887 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:00.540330 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:00.600522 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:00.608806 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5595dae5-fd4f-4a35-85a5-d16e548a5bbe tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1143 microversion: 2.1 time: 0.082563 May 31 22:46:00.609381 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 585/1166] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:00 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:46:01.625572 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:01.626170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:01.634421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:01.634894 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:01.635670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:01.636124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:01.715788 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:01.723564 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-2b030fea-be2e-4035-8cc1-a301ed756763 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1199 microversion: 2.1 time: 0.101840 May 31 22:46:01.724318 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 582/1167] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:01 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1199 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:02.740517 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:02.741250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:02.750364 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:02.751032 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:02.751905 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:02.752524 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:02.892399 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:02.899849 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6d19d6c7-0acd-4194-98b1-49d40919ed86 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1277 microversion: 2.1 time: 0.163315 May 31 22:46:02.900731 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 586/1168] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:02 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1277 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:03.504360 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-9a164302-4c1a-4956-ad43-0f5a5cebdd5d req-3f727eee-1840-4890-80ba-993b35c0540d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f8feed-7af9-4080-b2c1-2b94f8b2a469", "tag": "69012d37-0086-47e8-87bf-24c19e61399e"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:46:03.513641 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9a164302-4c1a-4956-ad43-0f5a5cebdd5d req-3f727eee-1840-4890-80ba-993b35c0540d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:03.514078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9a164302-4c1a-4956-ad43-0f5a5cebdd5d req-3f727eee-1840-4890-80ba-993b35c0540d service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:03.528814 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-9a164302-4c1a-4956-ad43-0f5a5cebdd5d req-3f727eee-1840-4890-80ba-993b35c0540d service nova] Creating event network-changed:69012d37-0086-47e8-87bf-24c19e61399e for instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 on hv-cinder-84414 May 31 22:46:03.534074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-9a164302-4c1a-4956-ad43-0f5a5cebdd5d req-3f727eee-1840-4890-80ba-993b35c0540d service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109231 May 31 22:46:03.534672 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 583/1169] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:46:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:46:03.917128 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:03.926223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:03.926223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:03.926223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:03.926223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:03.926611 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:04.053971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:04.061508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-41467c58-93c4-4352-91fe-844750afff3f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.148357 May 31 22:46:04.062067 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 587/1170] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:03 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:05.080101 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:05.083546 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:05.087950 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:05.088393 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:05.089153 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:05.089631 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:05.217684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:05.225096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-017a68ff-823b-4760-b9fd-5524ca7cbedd tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.149241 May 31 22:46:05.225691 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 584/1171] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:05 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:06.241498 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:06.245938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:06.248597 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:06.249044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:06.249805 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:06.250238 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:06.379716 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:06.387686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a711022e-d569-4c8c-9934-1efd9f80b892 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.150063 May 31 22:46:06.388250 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 588/1172] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:06 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:07.404895 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:07.405516 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:07.412020 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:07.412473 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:07.413247 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:07.414311 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:07.544316 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:07.551968 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-dd622957-f9db-4cd0-8c10-3875b581a48f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.150966 May 31 22:46:07.552542 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 585/1173] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:07 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:08.568475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:08.569098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:08.576136 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:08.576583 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:08.577343 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:08.577783 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:08.703509 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:08.711599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-14497eb9-a707-4d06-acbe-b2b9511471f5 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.147027 May 31 22:46:08.712171 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 589/1174] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:08 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:09.728699 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:09.729310 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:09.731827 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:46:09.736626 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:09.737073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:09.737839 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:09.738275 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:09.868624 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:09.876031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-ce11e78c-0fc3-451a-9558-5bafab7e3f9d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.151878 May 31 22:46:09.876832 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 586/1175] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:09 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:10.893222 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:10.893833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:10.895707 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:46:10.896354 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:46:10.902189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:10.908138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:10.908138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:10.908138 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:11.030218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:11.037584 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-929a6735-6b70-4524-bb01-be8cf6c9c93c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.148296 May 31 22:46:11.038140 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 590/1176] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:10 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:12.053989 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:12.054601 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:12.061102 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:12.061545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:12.062308 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:12.062747 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:12.192911 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:12.201019 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-112144da-b027-4035-b294-8af63d731ce4 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.150848 May 31 22:46:12.201800 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 587/1177] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:12 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:13.218675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:13.219319 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:13.226309 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:13.226729 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:13.227533 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:13.227971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:13.366337 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:13.367189 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-96fd932b-5e6d-4b9b-9b3e-836c660a8a0b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.152438 May 31 22:46:13.367764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 591/1178] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:13 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:13.442051 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-f8968321-5d1c-4258-8fd8-562632b7aaeb req-9ed79cf4-888a-462b-9f7b-943802aabc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f8feed-7af9-4080-b2c1-2b94f8b2a469", "name": "network-vif-plugged", "status": "completed", "tag": "69012d37-0086-47e8-87bf-24c19e61399e"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:46:13.450903 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f8968321-5d1c-4258-8fd8-562632b7aaeb req-9ed79cf4-888a-462b-9f7b-943802aabc5a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:13.451739 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-f8968321-5d1c-4258-8fd8-562632b7aaeb req-9ed79cf4-888a-462b-9f7b-943802aabc5a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:13.463115 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-f8968321-5d1c-4258-8fd8-562632b7aaeb req-9ed79cf4-888a-462b-9f7b-943802aabc5a service nova] Creating event network-vif-plugged:69012d37-0086-47e8-87bf-24c19e61399e for instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 on hv-cinder-84414 May 31 22:46:13.468058 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-f8968321-5d1c-4258-8fd8-562632b7aaeb req-9ed79cf4-888a-462b-9f7b-943802aabc5a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029810 May 31 22:46:13.468668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 588/1179] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:46:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:46:14.384609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:14.385223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:14.391756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:14.392206 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:14.392970 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:14.393411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:14.524433 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:14.531879 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6787c43d-7183-4775-ab5f-bc878b18658d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1265 microversion: 2.1 time: 0.151783 May 31 22:46:14.532440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 592/1180] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:14 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:46:15.550194 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:15.550965 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:15.557603 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:15.558078 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:15.558862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:15.559301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:15.687985 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:15.696041 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3bd5c0e4-b55a-4fe1-b8c7-1639a30b368b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1453 microversion: 2.1 time: 0.150967 May 31 22:46:15.696609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 589/1181] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:15 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:15.711613 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:46:15.712215 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:46:15.718680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:15.719149 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:15.719906 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:15.720338 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:15.849764 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:46:15.857142 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-f524053c-abc4-437c-ab59-9ef99e8bfe8e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1453 microversion: 2.1 time: 0.149338 May 31 22:46:15.857706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 593/1182] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:46:15 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:46:18.015164 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-9bdff4c3-1963-4a68-899f-53e7a0240014 req-23202433-d9b1-49e1-a189-69f8e75761fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65f8feed-7af9-4080-b2c1-2b94f8b2a469", "tag": "69012d37-0086-47e8-87bf-24c19e61399e"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:46:18.024239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9bdff4c3-1963-4a68-899f-53e7a0240014 req-23202433-d9b1-49e1-a189-69f8e75761fd service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:46:18.024680 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-9bdff4c3-1963-4a68-899f-53e7a0240014 req-23202433-d9b1-49e1-a189-69f8e75761fd service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:46:18.035419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-9bdff4c3-1963-4a68-899f-53e7a0240014 req-23202433-d9b1-49e1-a189-69f8e75761fd service nova] Creating event network-changed:69012d37-0086-47e8-87bf-24c19e61399e for instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 on hv-cinder-84414 May 31 22:46:18.040913 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-9bdff4c3-1963-4a68-899f-53e7a0240014 req-23202433-d9b1-49e1-a189-69f8e75761fd service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029608 May 31 22:46:18.041506 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 590/1183] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:47:35.535498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:47:35.536217 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:47:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:48:15.233161 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:15.233936 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=64 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:15.237886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:15.238367 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:15.244534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:15.244973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:15.245867 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:15.246300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:15.271563 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:48:15.547231 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-871a1304-a043-44dd-8f25-f762ef681464 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "DELETE /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 204 len: 0 microversion: 2.1 time: 0.315667 May 31 22:48:15.547733 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 594/1184] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:48:15 2022] DELETE /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:48:15.554043 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR oslo.messaging._drivers.impl_rabbit [-] [3eee522c-6920-4c91-a2f1-d068270cd0b1] AMQP server on 10.222.0.39:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 31 22:48:15.557359 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=22 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:15.557359 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=42 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:15.560350 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:15.561049 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:15.567281 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:15.567741 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:15.568503 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:15.568940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:15.697810 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:15.705893 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-09c4a10a-5b8e-4b89-8262-36b3582d607f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1578 microversion: 2.1 time: 0.153696 May 31 22:48:15.706455 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 591/1185] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:15 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:16.723580 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:16.724277 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:16.730897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:16.731345 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:16.732106 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:16.732540 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:16.861126 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:16.868639 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-4de8f56d-ffc3-49fb-a1fb-ac47a4708b4e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1578 microversion: 2.1 time: 0.149319 May 31 22:48:16.869198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 595/1186] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:16 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1578 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:17.886026 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:17.887063 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:17.894426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:17.894904 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:17.898936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:17.898936 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:17.915896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] [3eee522c-6920-4c91-a2f1-d068270cd0b1] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55808. May 31 22:48:18.116424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:18.124096 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-12fb88b9-1397-4f3e-8c8f-e803b0076f74 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1578 microversion: 2.1 time: 0.241984 May 31 22:48:18.124668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 592/1187] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:17 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1578 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:18.331674 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-ce46031d-79e3-4730-a86f-49b211a23f86 req-2b1111ef-78d2-47f4-b13e-d0d5eca70ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65f8feed-7af9-4080-b2c1-2b94f8b2a469", "name": "network-vif-deleted", "tag": "69012d37-0086-47e8-87bf-24c19e61399e"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:48:18.341757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ce46031d-79e3-4730-a86f-49b211a23f86 req-2b1111ef-78d2-47f4-b13e-d0d5eca70ec9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:18.346045 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-ce46031d-79e3-4730-a86f-49b211a23f86 req-2b1111ef-78d2-47f4-b13e-d0d5eca70ec9 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:18.354114 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-ce46031d-79e3-4730-a86f-49b211a23f86 req-2b1111ef-78d2-47f4-b13e-d0d5eca70ec9 service nova] Creating event network-vif-deleted:69012d37-0086-47e8-87bf-24c19e61399e for instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 on hv-cinder-84414 May 31 22:48:18.359353 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-ce46031d-79e3-4730-a86f-49b211a23f86 req-2b1111ef-78d2-47f4-b13e-d0d5eca70ec9 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031262 May 31 22:48:18.359918 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 596/1188] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:48:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:48:19.140981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:19.141647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:19.148189 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:19.148648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:19.149437 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:19.149879 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:19.183301 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:19.183769 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:19.184213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lazy-loading 'fault' on Instance uuid 65f8feed-7af9-4080-b2c1-2b94f8b2a469 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:48:19.225238 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:19.233225 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-5033e8db-61bf-4780-b19a-c60e6221485f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 200 len: 1229 microversion: 2.1 time: 0.096320 May 31 22:48:19.233795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 593/1189] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:19 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:20.253877 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:20.254564 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:20.260738 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:20.261181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:20.261930 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:20.262361 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:20.275139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] HTTP exception thrown: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Request method failure captured: May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 HTTP/1.1 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpqJgjHaR_WHKS67_eZg70-Zq7NU6V3om9O-napq433aXlA1lkUy4iayfwHhCcM9X2mVqraHKRLnhAwnLXcJMrWt59epSNzvSMMylJPJ-kHyKZqK7YAFZerhgGDlVkBTCFyU6Wq00oMHzMsc76dZTOuN12ze7pm_FlTrnu-zPeqFOX4 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:48:20.276758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1168cbb27e894d808f5118c0029ef9d7"}]}] May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-670812678 May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-670812678-project May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 8679b2fd35d0460993b736ef49f44ef6 May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-670812678-project May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:48:20.278523 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '65f8feed-7af9-4080-b2c1-2b94f8b2a469'} May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:48:20.279598 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:48:20.281228 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:48:20.282665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Returning 404 to user: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:48:20.282665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-6f5b66e1-0f4a-4ab8-8f16-f6682cc88059 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 404 len: 111 microversion: 2.1 time: 0.028951 May 31 22:48:20.282665 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 597/1190] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:20 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:48:20.351313 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-840356099", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-221896076", "security_groups": [{"name": "tempest-secgroup-smoke-1894243602"}], "block_device_mapping_v2": [{"uuid": "f11fdf8d-ec5c-4cc9-b06e-a6dc78c4e1c2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341538fb-e84e-4c05-a9e7-53b26bd532d0"}]}} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:48:20.461666 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.network.neutron [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] validate_networks() for [('341538fb-e84e-4c05-a9e7-53b26bd532d0', None, None, None, None, None)] {{(pid=124589) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:48:20.909046 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:48:20.909467 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image limits 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:48:20.909987 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:48:20.910394 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image pref 0:0:0 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:48:20.910828 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.virt.hardware [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124589) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:48:20.920639 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:20.921097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:20.921901 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:20.922342 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:20.938855 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:48:20.942821 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.quota [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for user 8679b2fd35d0460993b736ef49f44ef6 and project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124589) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:48:20.998415 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Going to run 1 instances... {{(pid=124589) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:48:21.000526 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f11fdf8d-ec5c-4cc9-b06e-a6dc78c4e1c2',volume_size=None,volume_type=None)] {{(pid=124589) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:48:21.397259 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-adbd4164-7e42-47f6-94bb-813c7f37408a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.049691 May 31 22:48:21.398215 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 594/1191] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:48:20 2022] POST /compute/v2.1/servers => generated 406 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:48:21.407831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-0e1cd9f5-adaa-45bc-968e-f1fe166be4ee tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:21.408457 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-0e1cd9f5-adaa-45bc-968e-f1fe166be4ee tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:21.466691 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-0e1cd9f5-adaa-45bc-968e-f1fe166be4ee tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:21.474194 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-0e1cd9f5-adaa-45bc-968e-f1fe166be4ee tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1093 microversion: 2.1 time: 0.070198 May 31 22:48:21.474758 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 598/1192] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:21 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:48:22.491358 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:22.491976 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:22.504464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:22.504464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:22.504464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:22.504464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:22.562597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:22.569870 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-15a41f08-c67f-4830-8287-6e6075a1e0e7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1143 microversion: 2.1 time: 0.082483 May 31 22:48:22.570579 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 595/1193] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:22 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1143 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:23.592251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:23.592251 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:23.595982 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:23.596624 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:23.597400 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:23.597886 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:23.658590 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:23.666173 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-8f116ae5-1da0-4ea7-9154-f05c05e5efa8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1209 microversion: 2.1 time: 0.082315 May 31 22:48:23.666742 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 599/1194] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:23 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1209 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:24.683156 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:24.683778 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:24.690292 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:24.690750 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:24.691559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:24.692005 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:24.907559 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:24.917421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-e675da83-050e-48de-85ad-7d93e9622aed tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1277 microversion: 2.1 time: 0.238138 May 31 22:48:24.918432 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 596/1195] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:24 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:25.126363 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-c15b8add-f5db-4624-b4fa-bf82535cf074 req-998668a5-3c36-4235-bef6-720232e09844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85633c0-433a-4fd0-bab4-00f032df2182", "tag": "c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:48:25.135270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-c15b8add-f5db-4624-b4fa-bf82535cf074 req-998668a5-3c36-4235-bef6-720232e09844 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:25.135955 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-c15b8add-f5db-4624-b4fa-bf82535cf074 req-998668a5-3c36-4235-bef6-720232e09844 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:25.148755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-c15b8add-f5db-4624-b4fa-bf82535cf074 req-998668a5-3c36-4235-bef6-720232e09844 service nova] Creating event network-changed:c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6 for instance e85633c0-433a-4fd0-bab4-00f032df2182 on hv-cinder-84414 May 31 22:48:25.154134 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-c15b8add-f5db-4624-b4fa-bf82535cf074 req-998668a5-3c36-4235-bef6-720232e09844 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031840 May 31 22:48:25.155356 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 600/1196] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:48:25.934037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:25.934718 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:25.941252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:25.941694 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:25.942457 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:25.942921 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:26.072872 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:26.080762 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-0e357e7a-9fde-4fb8-9af9-7532e7b3c4cf tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.151121 May 31 22:48:26.081324 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 597/1197] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:25 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:27.098534 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:27.099257 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:27.105491 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:27.105943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:27.106708 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:27.107177 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:27.235808 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:27.243112 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-61c6c7a6-7b07-4944-b61f-d0bdefad0e9e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.149339 May 31 22:48:27.243697 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 601/1198] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:27 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:28.259464 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:28.260105 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:28.267211 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:28.267661 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:28.268423 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:28.268862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:28.396923 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:28.404474 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d6f35c57-2094-4d3c-9ac3-780c0b1a058b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.148847 May 31 22:48:28.405031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 598/1199] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:28 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:29.421368 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:29.421976 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:29.428392 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:29.428839 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:29.429599 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:29.430038 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:29.559857 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:29.567609 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-d4a9dd49-3027-4c8a-8fdf-1bde99004cf8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.150358 May 31 22:48:29.568164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 602/1200] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:29 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:30.584678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:30.585293 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:30.591776 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:30.592171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:30.592929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:30.593363 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:30.726680 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:30.732994 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9ffdee23-2c29-42cd-8b7a-5c8cbfcf8c47 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.152174 May 31 22:48:30.733561 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 599/1201] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:30 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:31.749923 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:31.750532 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:31.753037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:31.758041 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:31.758426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:31.759401 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:31.759833 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:31.890915 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:31.898823 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-56fe50ec-e92b-4318-87f5-66bdcad9dc93 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.153361 May 31 22:48:31.899411 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 603/1202] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:31 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:32.915926 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:32.916514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:32.918450 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:32.919286 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=6 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:48:32.924677 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:32.925124 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:32.925929 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:32.926366 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:33.057421 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:33.065545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-59b1e912-11f9-4cf6-bc23-da032ca625e3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.153500 May 31 22:48:33.066108 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 600/1203] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:32 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:34.082498 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:34.083119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:34.090113 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:34.090566 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:34.091490 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:34.092222 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:34.107978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-48799eb5-5b53-4542-ade9-e9362c8649fa req-b6a5c92f-1d8b-487b-8a9d-371eaa416b4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85633c0-433a-4fd0-bab4-00f032df2182", "name": "network-vif-plugged", "status": "completed", "tag": "c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:48:34.117221 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-48799eb5-5b53-4542-ade9-e9362c8649fa req-b6a5c92f-1d8b-487b-8a9d-371eaa416b4c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:34.117661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-48799eb5-5b53-4542-ade9-e9362c8649fa req-b6a5c92f-1d8b-487b-8a9d-371eaa416b4c service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:34.129778 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-48799eb5-5b53-4542-ade9-e9362c8649fa req-b6a5c92f-1d8b-487b-8a9d-371eaa416b4c service nova] Creating event network-vif-plugged:c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6 for instance e85633c0-433a-4fd0-bab4-00f032df2182 on hv-cinder-84414 May 31 22:48:34.140006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-48799eb5-5b53-4542-ade9-e9362c8649fa req-b6a5c92f-1d8b-487b-8a9d-371eaa416b4c service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129398 May 31 22:48:34.140006 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 604/1204] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:48:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:48:34.227527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:34.235527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-b8f430f1-4ba6-44ce-af1d-ba1cb6307718 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.156830 May 31 22:48:34.236120 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 601/1205] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:34 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:48:35.252942 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:35.253636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:35.260220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:35.260666 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:35.261417 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:35.261848 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:35.390208 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:35.397631 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-5e1baf9d-1864-4090-a27b-434afb882c5d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1265 microversion: 2.1 time: 0.148860 May 31 22:48:35.398214 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 605/1206] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:35 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:36.414703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:36.415364 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:36.422125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:36.422577 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:36.423419 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:36.423862 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:36.552940 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:36.560951 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-615a2788-9c8b-4a4d-9b2e-1699c0be655d tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1453 microversion: 2.1 time: 0.150167 May 31 22:48:36.561514 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 602/1207] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:36 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:36.577648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:48:36.578261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:48:36.584656 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:36.585101 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:36.585858 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:36.586295 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:36.715121 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:48:36.722463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-9f16e78a-cbf5-4a05-9893-e603be809ca7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1453 microversion: 2.1 time: 0.149244 May 31 22:48:36.723044 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 606/1208] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:48:36 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:48:38.690990 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-92614956-9771-4db8-a845-d36871261380 req-0b1a6bb0-1768-46f9-9125-4e654ea87be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85633c0-433a-4fd0-bab4-00f032df2182", "tag": "c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:48:38.699716 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-92614956-9771-4db8-a845-d36871261380 req-0b1a6bb0-1768-46f9-9125-4e654ea87be2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:48:38.700165 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-92614956-9771-4db8-a845-d36871261380 req-0b1a6bb0-1768-46f9-9125-4e654ea87be2 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:48:38.711453 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-92614956-9771-4db8-a845-d36871261380 req-0b1a6bb0-1768-46f9-9125-4e654ea87be2 service nova] Creating event network-changed:c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6 for instance e85633c0-433a-4fd0-bab4-00f032df2182 on hv-cinder-84414 May 31 22:48:38.716885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-92614956-9771-4db8-a845-d36871261380 req-0b1a6bb0-1768-46f9-9125-4e654ea87be2 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085281 May 31 22:48:38.717678 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 603/1209] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:48:50.151122 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:48:50.151655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:48:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:48:54.168783 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:48:54.169337 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:48:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:48:55.633928 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:48:55.634482 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:48:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:50:24.802718 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR oslo.messaging._drivers.impl_rabbit [-] [142227fe-6654-42e4-94d0-3fb3bb02696e] AMQP server on 10.222.0.39:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 31 22:50:24.803558 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:24.804294 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:24.808218 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-157797704", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-221896076", "security_groups": [{"name": "tempest-secgroup-smoke-1894243602"}], "block_device_mapping_v2": [{"uuid": "8287ecb1-e45c-4c35-b76e-7e5634a38023", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "341538fb-e84e-4c05-a9e7-53b26bd532d0"}]}} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:50:24.919139 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.network.neutron [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] validate_networks() for [('341538fb-e84e-4c05-a9e7-53b26bd532d0', None, None, None, None, None)] {{(pid=124590) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 31 22:50:25.281314 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 31 22:50:25.281762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image limits 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 31 22:50:25.282379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Flavor pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 31 22:50:25.282811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Image pref 0:0:0 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 31 22:50:25.283232 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.virt.hardware [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124590) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 31 22:50:25.291974 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:25.292426 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:25.293224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:25.293926 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:25.310680 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 31 22:50:25.315285 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.quota [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Getting quotas for user 8679b2fd35d0460993b736ef49f44ef6 and project 1168cbb27e894d808f5118c0029ef9d7. Resources: {'ram', 'instances', 'cores'} {{(pid=124590) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 31 22:50:25.370508 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Going to run 1 instances... {{(pid=124590) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 31 22:50:25.372864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8287ecb1-e45c-4c35-b76e-7e5634a38023',volume_size=None,volume_type=None)] {{(pid=124590) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 31 22:50:25.803938 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-ad78e2df-4dbd-4cc7-8484-0cf9280558aa tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.002969 May 31 22:50:25.804854 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 607/1210] 10.222.0.39 () {60 vars in 1146 bytes} [Tue May 31 22:50:24 2022] POST /compute/v2.1/servers => generated 406 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 31 22:50:25.812779 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:25.814999 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=72 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:25.817981 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d17d3f50-a1ce-4962-8c3d-7144651a9132 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:25.819361 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d17d3f50-a1ce-4962-8c3d-7144651a9132 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:25.875122 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d17d3f50-a1ce-4962-8c3d-7144651a9132 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:25.882861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d17d3f50-a1ce-4962-8c3d-7144651a9132 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1093 microversion: 2.1 time: 0.072012 May 31 22:50:25.883426 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 604/1211] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:25 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:26.900475 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:26.901088 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:26.908518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:26.908973 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:26.909755 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:26.910195 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:26.916418 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] [142227fe-6654-42e4-94d0-3fb3bb02696e] Reconnected to AMQP server on 10.222.0.39:5672 via [amqp] client with port 55984. May 31 22:50:26.973440 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:26.980891 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dd91d158-21c1-4a1f-8999-168aeb9f4a2e tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1143 microversion: 2.1 time: 0.084958 May 31 22:50:26.981460 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 608/1212] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:26 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1143 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:27.998573 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:27.999278 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:28.006396 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:28.006890 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:28.007725 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:28.008157 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:28.089470 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:28.097856 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d1194e46-99cd-4b14-968f-aaa40e76e903 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1209 microversion: 2.1 time: 0.103899 May 31 22:50:28.098848 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 605/1213] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:27 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1209 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:50:29.115538 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:29.123431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:29.123872 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:29.124354 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:29.125120 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:29.125553 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:29.259720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:29.268028 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a3e77114-f5bf-4c8c-8ed5-3f16f284185c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1277 microversion: 2.1 time: 0.156979 May 31 22:50:29.271811 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 609/1214] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:29 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1277 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:29.588501 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-15d3bef6-39cb-446b-a86b-33e4b9021d2a req-caff38f2-25bf-4d23-8704-b95043a90d5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab03b359-e385-4d5d-a290-667c964e493e", "tag": "ce7db565-6155-4c62-9fa5-506fd9b1d760"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:50:29.600914 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-15d3bef6-39cb-446b-a86b-33e4b9021d2a req-caff38f2-25bf-4d23-8704-b95043a90d5f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:29.601460 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-15d3bef6-39cb-446b-a86b-33e4b9021d2a req-caff38f2-25bf-4d23-8704-b95043a90d5f service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:29.613452 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-15d3bef6-39cb-446b-a86b-33e4b9021d2a req-caff38f2-25bf-4d23-8704-b95043a90d5f service nova] Creating event network-changed:ce7db565-6155-4c62-9fa5-506fd9b1d760 for instance ab03b359-e385-4d5d-a290-667c964e493e on hv-cinder-84414 May 31 22:50:29.624427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-15d3bef6-39cb-446b-a86b-33e4b9021d2a req-caff38f2-25bf-4d23-8704-b95043a90d5f service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034291 May 31 22:50:29.624427 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 606/1215] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:50:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:50:30.285352 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:30.286066 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:30.292750 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:30.293276 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:30.294365 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:30.294823 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:30.430961 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:30.438303 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-36d19ae9-795b-4f27-85a1-98b0383a7502 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.157309 May 31 22:50:30.439145 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 610/1216] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:30 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:31.456780 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:31.457477 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:31.463672 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:31.464125 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:31.464892 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:31.465331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:31.592705 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:31.601001 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-008bd7ba-ec4a-471a-9976-107a4e81a67c tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.149376 May 31 22:50:31.601563 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 607/1217] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:31 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:32.618019 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:32.618626 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:32.625072 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:32.625518 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:32.626270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:32.626701 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:32.759907 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:32.768258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-33607f98-a4d8-42f8-a2fe-0586ee0eb6ae tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.153570 May 31 22:50:32.768834 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 611/1218] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:32 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:33.785618 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:33.786230 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:33.792629 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:33.793073 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:33.794090 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:33.794520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:33.924285 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:33.931679 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-be9ff72b-003c-4ed1-af22-6bc77ba04688 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.150578 May 31 22:50:33.932250 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 608/1219] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:33 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:34.948943 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:34.949556 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:34.956107 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:34.962505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:34.962505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:34.962505 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:35.088402 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:35.096497 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-93a4fb52-12f2-4969-b2a9-88ed81549ec0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.150802 May 31 22:50:35.097062 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 612/1220] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:34 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:36.112252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:36.112861 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:36.115543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell0:SELECT=2 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:36.120527 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:36.120989 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:36.121733 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:36.122167 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:36.251213 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:36.259131 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-7a978298-45ae-4fe0-82e7-2e7e2c64b76f tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.150707 May 31 22:50:36.259691 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 609/1221] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:36 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:37.276203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:37.276807 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:37.278636 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=2 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:37.279298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell0:SELECT=6 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:50:37.285151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:37.287123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:37.287123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:37.287123 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:37.459297 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:37.466675 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-30f6cee5-d340-4102-a30d-a84248c93698 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.194328 May 31 22:50:37.467258 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 613/1222] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:37 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:38.483528 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:38.484144 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:38.490549 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:38.501070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:38.501070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:38.501070 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:38.624519 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:38.632609 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-bc5bfc66-d57d-4dfd-aef1-98531af8f56b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.153004 May 31 22:50:38.633333 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 610/1223] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:38 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:39.649521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:39.650133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:39.656757 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:39.657205 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:39.657965 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:39.659075 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:40.026978 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:40.035050 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24d345da-f877-43f9-a37b-1602c97f0382 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.389389 May 31 22:50:40.035615 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 614/1224] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:39 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:40.543598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-4ddec8d0-33d3-43c5-bccb-c9d94377e4de req-ccc2ef91-238a-45fd-94ca-b6cca9f9a7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab03b359-e385-4d5d-a290-667c964e493e", "name": "network-vif-plugged", "status": "completed", "tag": "ce7db565-6155-4c62-9fa5-506fd9b1d760"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:50:40.552642 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-4ddec8d0-33d3-43c5-bccb-c9d94377e4de req-ccc2ef91-238a-45fd-94ca-b6cca9f9a7cf service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:40.553088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-4ddec8d0-33d3-43c5-bccb-c9d94377e4de req-ccc2ef91-238a-45fd-94ca-b6cca9f9a7cf service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:40.563581 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-4ddec8d0-33d3-43c5-bccb-c9d94377e4de req-ccc2ef91-238a-45fd-94ca-b6cca9f9a7cf service nova] Creating event network-vif-plugged:ce7db565-6155-4c62-9fa5-506fd9b1d760 for instance ab03b359-e385-4d5d-a290-667c964e493e on hv-cinder-84414 May 31 22:50:40.569269 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-4ddec8d0-33d3-43c5-bccb-c9d94377e4de req-ccc2ef91-238a-45fd-94ca-b6cca9f9a7cf service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029591 May 31 22:50:40.569854 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 611/1225] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:50:41.052096 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:41.052696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:41.059025 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:41.059468 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:41.060220 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:41.060648 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:41.186865 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:41.195224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2ade169f-4559-42ee-b144-aa7adba36349 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.147014 May 31 22:50:41.195790 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 615/1226] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:41 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:42.213927 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:42.214625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:42.220825 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:42.223109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:42.223109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:42.223109 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:42.357633 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:42.365344 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-6309b063-30f8-40b6-85c0-7f5110eebc54 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1265 microversion: 2.1 time: 0.156095 May 31 22:50:42.365907 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 612/1227] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:42 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:43.382043 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:43.382678 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:43.389181 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:43.389625 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:43.390384 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:43.390838 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:43.520462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:43.527864 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-a92c80f5-c1fb-4536-bce9-91e183e41123 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1453 microversion: 2.1 time: 0.149695 May 31 22:50:43.528431 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 616/1228] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:43 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:43.544804 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:50:43.545413 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:50:43.551801 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:43.552244 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:43.553002 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:43.553434 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:43.682545 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:50:43.690756 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3e4fb1e5-6a5b-4d82-aaeb-40a111665a24 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1453 microversion: 2.1 time: 0.149524 May 31 22:50:43.692882 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 613/1229] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:50:43 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:50:45.647944 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-e5eecdf1-e2f8-4317-a1b4-41018c184c31 req-b7966802-a267-4ba5-90c2-1b57d0580a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab03b359-e385-4d5d-a290-667c964e493e", "tag": "ce7db565-6155-4c62-9fa5-506fd9b1d760"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:50:45.656379 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e5eecdf1-e2f8-4317-a1b4-41018c184c31 req-b7966802-a267-4ba5-90c2-1b57d0580a5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:50:45.656822 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e5eecdf1-e2f8-4317-a1b4-41018c184c31 req-b7966802-a267-4ba5-90c2-1b57d0580a5e service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:50:45.667909 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-e5eecdf1-e2f8-4317-a1b4-41018c184c31 req-b7966802-a267-4ba5-90c2-1b57d0580a5e service nova] Creating event network-changed:ce7db565-6155-4c62-9fa5-506fd9b1d760 for instance ab03b359-e385-4d5d-a290-667c964e493e on hv-cinder-84414 May 31 22:50:45.673463 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-e5eecdf1-e2f8-4317-a1b4-41018c184c31 req-b7966802-a267-4ba5-90c2-1b57d0580a5e service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029101 May 31 22:50:45.674151 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 617/1230] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:50:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:50:55.545785 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:50:55.546424 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:50:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:52:14.176438 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:52:14.177088 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:52:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:52:14.888689 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_api:SELECT=22 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:52:14.889544 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:52:14.890012 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG dbcounter [-] [124589] Writing DB stats nova_cell1:SELECT=46 {{(pid=124589) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:52:14.890655 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG dbcounter [-] [124590] Writing DB stats nova_cell1:SELECT=58 {{(pid=124590) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 31 22:52:14.893673 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:14.894170 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:14.900863 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:14.901647 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:14.902635 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:14.903091 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:14.929893 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Going to try to terminate instance {{(pid=124589) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:52:14.951519 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-1ae04715-e951-4119-bac2-eeb62a570035 req-466d98e4-be81-42a4-8d14-aeba108d2dd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab03b359-e385-4d5d-a290-667c964e493e", "tag": "ce7db565-6155-4c62-9fa5-506fd9b1d760"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:52:14.960140 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1ae04715-e951-4119-bac2-eeb62a570035 req-466d98e4-be81-42a4-8d14-aeba108d2dd4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:14.960581 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-1ae04715-e951-4119-bac2-eeb62a570035 req-466d98e4-be81-42a4-8d14-aeba108d2dd4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:14.972082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-1ae04715-e951-4119-bac2-eeb62a570035 req-466d98e4-be81-42a4-8d14-aeba108d2dd4 service nova] Creating event network-changed:ce7db565-6155-4c62-9fa5-506fd9b1d760 for instance ab03b359-e385-4d5d-a290-667c964e493e on hv-cinder-84414 May 31 22:52:14.977154 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-1ae04715-e951-4119-bac2-eeb62a570035 req-466d98e4-be81-42a4-8d14-aeba108d2dd4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089951 May 31 22:52:14.977780 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 618/1231] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:52:15.279885 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-317cf57a-24e1-48a8-b755-eb875ab08783 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "DELETE /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 204 len: 0 microversion: 2.1 time: 0.392744 May 31 22:52:15.283896 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 614/1232] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:52:14 2022] DELETE /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:52:15.290286 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:15.291037 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:15.299908 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:15.300357 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:15.301466 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:15.302483 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:15.484958 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:15.492408 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-95598c24-86c3-46e7-9dcb-e2941f414a17 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1577 microversion: 2.1 time: 0.207249 May 31 22:52:15.493224 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 619/1233] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:15 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:52:15.642133 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:52:15.642320 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:52:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:52:16.510858 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:16.511552 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:16.518239 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:16.518683 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:16.519467 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:16.519897 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:16.728520 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:16.737031 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-94ab2136-be52-42b7-92a4-9cb8ba624681 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1577 microversion: 2.1 time: 0.230343 May 31 22:52:16.737594 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 615/1234] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:16 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1577 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:17.644358 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [req-e6fdc36b-65b9-4e62-acbf-a94291949647 req-71700e75-8ada-4ac2-be6b-fe3ac49a2461 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab03b359-e385-4d5d-a290-667c964e493e", "name": "network-vif-deleted", "tag": "ce7db565-6155-4c62-9fa5-506fd9b1d760"}]} {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:52:17.652751 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e6fdc36b-65b9-4e62-acbf-a94291949647 req-71700e75-8ada-4ac2-be6b-fe3ac49a2461 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:17.653211 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [req-e6fdc36b-65b9-4e62-acbf-a94291949647 req-71700e75-8ada-4ac2-be6b-fe3ac49a2461 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:17.663911 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.compute.server_external_events [req-e6fdc36b-65b9-4e62-acbf-a94291949647 req-71700e75-8ada-4ac2-be6b-fe3ac49a2461 service nova] Creating event network-vif-deleted:ce7db565-6155-4c62-9fa5-506fd9b1d760 for instance ab03b359-e385-4d5d-a290-667c964e493e on hv-cinder-84414 May 31 22:52:17.668845 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [req-e6fdc36b-65b9-4e62-acbf-a94291949647 req-71700e75-8ada-4ac2-be6b-fe3ac49a2461 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028524 May 31 22:52:17.669417 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 620/1235] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:52:17.756670 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:17.757284 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:17.763660 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:17.767840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:17.767840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:17.767840 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:17.826903 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:17.834590 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d5ce6783-bd74-44c2-a1f0-76fc896ee1d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1391 microversion: 2.1 time: 0.082726 May 31 22:52:17.835195 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 616/1236] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:17 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1391 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:18.852706 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:18.853393 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:18.859720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:18.861455 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:18.862223 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:18.862661 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:18.893897 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:18.894264 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:18.894713 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.objects.instance [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lazy-loading 'fault' on Instance uuid ab03b359-e385-4d5d-a290-667c964e493e {{(pid=124590) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:52:18.935971 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:18.944098 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-dad73008-bbc2-481f-8195-133e076d865b tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 200 len: 1229 microversion: 2.1 time: 0.096045 May 31 22:52:18.944660 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 621/1237] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:18 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:19.961087 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:19.961695 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: ab03b359-e385-4d5d-a290-667c964e493e] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:19.967795 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:19.968184 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:19.968944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:19.969380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:19.982944 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] HTTP exception thrown: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Request method failure captured: May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e HTTP/1.1 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpqJgjHaR_WHKS67_eZg70-Zq7NU6V3om9O-napq433aXlA1lkUy4iayfwHhCcM9X2mVqraHKRLnhAwnLXcJMrWt59epSNzvSMMylJPJ-kHyKZqK7YAFZerhgGDlVkBTCFyU6Wq00oMHzMsc76dZTOuN12ze7pm_FlTrnu-zPeqFOX4 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:52:19.984550 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1168cbb27e894d808f5118c0029ef9d7"}]}] May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestVolumeBootPattern-670812678 May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 8679b2fd35d0460993b736ef49f44ef6 May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. May 31 22:52:19.986348 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': 'ab03b359-e385-4d5d-a290-667c964e493e'} May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:52:19.987362 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. May 31 22:52:19.989118 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:19.990684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Returning 404 to user: Instance ab03b359-e385-4d5d-a290-667c964e493e could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:52:19.990684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-be395ad6-0f9d-4534-893c-c0b1d6f46a46 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e" status: 404 len: 111 microversion: 2.1 time: 0.029406 May 31 22:52:19.990684 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 617/1238] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:19 2022] GET /compute/v2.1/servers/ab03b359-e385-4d5d-a290-667c964e493e => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:52:23.280198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:23.280831 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:23.282864 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-2e4f1d9d-67d3-48dd-b282-7e25e6b610be req-45ebd11d-a8ba-4b47-a777-85c0731dbd0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e85633c0-433a-4fd0-bab4-00f032df2182", "tag": "c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:52:23.287853 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:23.288292 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:23.289261 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:23.289696 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:23.293320 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2e4f1d9d-67d3-48dd-b282-7e25e6b610be req-45ebd11d-a8ba-4b47-a777-85c0731dbd0a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:23.293941 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-2e4f1d9d-67d3-48dd-b282-7e25e6b610be req-45ebd11d-a8ba-4b47-a777-85c0731dbd0a service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:23.306111 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-2e4f1d9d-67d3-48dd-b282-7e25e6b610be req-45ebd11d-a8ba-4b47-a777-85c0731dbd0a service nova] Creating event network-changed:c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6 for instance e85633c0-433a-4fd0-bab4-00f032df2182 on hv-cinder-84414 May 31 22:52:23.311171 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-2e4f1d9d-67d3-48dd-b282-7e25e6b610be req-45ebd11d-a8ba-4b47-a777-85c0731dbd0a service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032109 May 31 22:52:23.311761 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 618/1239] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:52:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 31 22:52:23.318305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Going to try to terminate instance {{(pid=124590) delete /opt/stack/nova/nova/compute/api.py:2664}} May 31 22:52:23.652366 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-2d8985f1-e4fb-403f-a8da-fcfc522a6b1a tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "DELETE /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 204 len: 0 microversion: 2.1 time: 0.375698 May 31 22:52:23.653376 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 622/1240] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:52:23 2022] DELETE /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 31 22:52:23.662331 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:23.664136 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:23.670071 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:23.670648 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:23.671533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:23.672080 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:23.834185 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:23.842097 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-9e1ca8fa-3f3c-4675-9569-a10ecf58c742 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1578 microversion: 2.1 time: 0.184340 May 31 22:52:23.842758 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 619/1241] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:23 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1578 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 31 22:52:24.859630 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:24.860305 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:24.867462 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:24.867901 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:24.868652 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:24.869082 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:24.996762 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:25.004300 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-39e61d87-d30a-4b37-bed2-eab99b63e6f0 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1578 microversion: 2.1 time: 0.148990 May 31 22:52:25.004873 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 623/1242] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:24 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:25.936488 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [req-1c0233c4-1730-43ce-8db6-c1305b536aa6 req-f3f32b60-06f0-4637-b9f2-2aa5aaee5cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e85633c0-433a-4fd0-bab4-00f032df2182", "name": "network-vif-deleted", "tag": "c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6"}]} {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 31 22:52:25.945938 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1c0233c4-1730-43ce-8db6-c1305b536aa6 req-f3f32b60-06f0-4637-b9f2-2aa5aaee5cf4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:25.951625 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [req-1c0233c4-1730-43ce-8db6-c1305b536aa6 req-f3f32b60-06f0-4637-b9f2-2aa5aaee5cf4 service nova] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:25.957047 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.compute.server_external_events [req-1c0233c4-1730-43ce-8db6-c1305b536aa6 req-f3f32b60-06f0-4637-b9f2-2aa5aaee5cf4 service nova] Creating event network-vif-deleted:c5bb76c7-9d69-40fe-9f72-4f6f4b3abbc6 for instance e85633c0-433a-4fd0-bab4-00f032df2182 on hv-cinder-84414 May 31 22:52:25.961874 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [req-1c0233c4-1730-43ce-8db6-c1305b536aa6 req-f3f32b60-06f0-4637-b9f2-2aa5aaee5cf4 service nova] 10.222.0.39 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029109 May 31 22:52:25.962454 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 620/1243] 10.222.0.39 () {64 vars in 1317 bytes} [Tue May 31 22:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 31 22:52:26.021437 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:26.022047 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:26.028900 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:26.029375 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:26.030148 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:26.030585 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:26.095283 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.policy [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124590) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:26.102686 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-3f4c5068-78ff-41db-9ba7-3c540c4b43d3 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1224 microversion: 2.1 time: 0.085247 May 31 22:52:26.103290 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 624/1244] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:26 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1224 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:27.120607 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:27.121252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:27.127386 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:27.127841 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:27.128598 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:27.129037 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:27.180533 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:27.180977 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:27.181418 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.objects.instance [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lazy-loading 'fault' on Instance uuid e85633c0-433a-4fd0-bab4-00f032df2182 {{(pid=124589) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 31 22:52:27.223149 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.policy [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8679b2fd35d0460993b736ef49f44ef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1168cbb27e894d808f5118c0029ef9d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124589) authorize /opt/stack/nova/nova/policy.py:199}} May 31 22:52:27.230668 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-3cf5d9c8-7d11-4f5a-983b-8a632f8b4607 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 200 len: 1229 microversion: 2.1 time: 0.114842 May 31 22:52:27.231252 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 621/1245] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:27 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 1229 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 31 22:52:28.247103 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:28.247720 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: e85633c0-433a-4fd0-bab4-00f032df2182] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:28.253756 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.254203 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.254997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.255438 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.268270 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] HTTP exception thrown: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Request method failure captured: May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 HTTP/1.1 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpqJgjHaR_WHKS67_eZg70-Zq7NU6V3om9O-napq433aXlA1lkUy4iayfwHhCcM9X2mVqraHKRLnhAwnLXcJMrWt59epSNzvSMMylJPJ-kHyKZqK7YAFZerhgGDlVkBTCFyU6Wq00oMHzMsc76dZTOuN12ze7pm_FlTrnu-zPeqFOX4 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:52:28.269878 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1168cbb27e894d808f5118c0029ef9d7"}]}] May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 8679b2fd35d0460993b736ef49f44ef6 May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. May 31 22:52:28.272164 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': 'e85633c0-433a-4fd0-bab4-00f032df2182'} May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:52:28.273284 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. May 31 22:52:28.274997 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.276562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Returning 404 to user: Instance e85633c0-433a-4fd0-bab4-00f032df2182 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:52:28.276562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-aa130e3b-a4fb-412e-ae8e-7053069731c7 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182" status: 404 len: 111 microversion: 2.1 time: 0.028773 May 31 22:52:28.276562 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 625/1246] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:28 2022] GET /compute/v2.1/servers/e85633c0-433a-4fd0-bab4-00f032df2182 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:52:28.759649 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:28.760202 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.compute.api [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124589) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:28.766759 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.767262 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.768027 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.768462 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG oslo_concurrency.lockutils [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124589) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.782048 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.wsgi [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] HTTP exception thrown: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Request method failure captured: May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: request: DELETE /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 HTTP/1.1 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept: application/json May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Accept-Encoding: identity May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Connection: close May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Length: 0 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Content-Type: application/json May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Host: 10.222.0.39 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Openstack-System-Scope: None May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: User-Agent: python-urllib3/1.26.9 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Auth-Token: gAAAAABilpqJgjHaR_WHKS67_eZg70-Zq7NU6V3om9O-napq433aXlA1lkUy4iayfwHhCcM9X2mVqraHKRLnhAwnLXcJMrWt59epSNzvSMMylJPJ-kHyKZqK7YAFZerhgGDlVkBTCFyU6Wq00oMHzMsc76dZTOuN12ze7pm_FlTrnu-zPeqFOX4 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Id: None May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Domain-Name: None May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Identity-Status: Confirmed May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Is-Admin-Project: True May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Id: default May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Domain-Name: Default May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Project-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Role: reader,member May 31 22:52:28.783703 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Roles: reader,member May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1168cbb27e894d808f5118c0029ef9d7"}]}] May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-Tenant-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Id: default May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Domain-Name: Default May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Id: 8679b2fd35d0460993b736ef49f44ef6 May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: X-User-Name: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: method: > May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: exception: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.785375 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: action_args: {'id': '65f8feed-7af9-4080-b2c1-2b94f8b2a469'} May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:52:28.786380 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.788074 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: ERROR nova.api.openstack.wsgi May 31 22:52:28.790543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Returning 404 to user: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. {{(pid=124589) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:52:28.790543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-283fa5e3-973b-4153-9d93-4bbbfd82cd33 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "DELETE /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 404 len: 111 microversion: 2.1 time: 0.029337 May 31 22:52:28.790543 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 622/1247] 10.222.0.39 () {58 vars in 1238 bytes} [Tue May 31 22:52:28 2022] DELETE /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:52:28.794182 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '>' {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:28.794842 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.compute.api [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] [instance: 65f8feed-7af9-4080-b2c1-2b94f8b2a469] Fetching instance by UUID {{(pid=124590) get /opt/stack/nova/nova/compute/api.py:2920}} May 31 22:52:28.800849 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.801298 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.802086 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 31 22:52:28.802521 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG oslo_concurrency.lockutils [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Lock "aa724526-4fde-4fd6-8234-378dff7993fa" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124590) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 31 22:52:28.816198 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.wsgi [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] HTTP exception thrown: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Request method failure captured: May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: request: GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 HTTP/1.1 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept: application/json May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Accept-Encoding: identity May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Connection: close May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Length: 0 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Content-Type: application/json May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Host: 10.222.0.39 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Openstack-System-Scope: None May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: User-Agent: python-urllib3/1.26.9 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Auth-Token: gAAAAABilpqJgjHaR_WHKS67_eZg70-Zq7NU6V3om9O-napq433aXlA1lkUy4iayfwHhCcM9X2mVqraHKRLnhAwnLXcJMrWt59epSNzvSMMylJPJ-kHyKZqK7YAFZerhgGDlVkBTCFyU6Wq00oMHzMsc76dZTOuN12ze7pm_FlTrnu-zPeqFOX4 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Id: None May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Domain-Name: None May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Identity-Status: Confirmed May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Is-Admin-Project: True May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Id: default May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Domain-Name: Default May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Project-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Role: reader,member May 31 22:52:28.818237 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Roles: reader,member May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/compute/v2/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/volume/v3/1168cbb27e894d808f5118c0029ef9d7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.39/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.39:8080", "publicURL": "http://10.222.0.39:8080/v1/AUTH_1168cbb27e894d808f5118c0029ef9d7"}]}] May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Id: 1168cbb27e894d808f5118c0029ef9d7 May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-Tenant-Name: tempest-TestVolumeBootPattern-670812678 May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Id: default May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Domain-Name: Default May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Id: 8679b2fd35d0460993b736ef49f44ef6 May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: X-User-Name: tempest-TestVolumeBootPattern-670812678-project May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: method: > May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: exception: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.820039 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: action_args: {'id': '65f8feed-7af9-4080-b2c1-2b94f8b2a469'} May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: {{(pid=124590) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 31 22:52:28.821200 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. May 31 22:52:28.822837 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: ERROR nova.api.openstack.wsgi May 31 22:52:28.824394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: DEBUG nova.api.openstack.wsgi [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Returning 404 to user: Instance 65f8feed-7af9-4080-b2c1-2b94f8b2a469 could not be found. {{(pid=124590) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 31 22:52:28.824394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO nova.api.openstack.requestlog [None req-24451c88-1fe6-4ab9-a0fc-dba74e261cdc tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469" status: 404 len: 111 microversion: 2.1 time: 0.029563 May 31 22:52:28.824394 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: [pid: 124590|app: 0|req: 626/1248] 10.222.0.39 () {58 vars in 1235 bytes} [Tue May 31 22:52:28 2022] GET /compute/v2.1/servers/65f8feed-7af9-4080-b2c1-2b94f8b2a469 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 31 22:52:30.326242 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: DEBUG nova.api.openstack.wsgi [None req-d740dc31-3640-45f6-b5ed-64b7d094a8e8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] Calling method '.version_select at 0x7ff46365eb80>' {{(pid=124589) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 31 22:52:30.405652 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO nova.api.openstack.requestlog [None req-d740dc31-3640-45f6-b5ed-64b7d094a8e8 tempest-TestVolumeBootPattern-670812678 tempest-TestVolumeBootPattern-670812678-project] 10.222.0.39 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-221896076" status: 202 len: 0 microversion: 2.1 time: 0.083411 May 31 22:52:30.406249 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: [pid: 124589|app: 0|req: 623/1249] 10.222.0.39 () {58 vars in 1259 bytes} [Tue May 31 22:52:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-221896076 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 31 22:54:15.553986 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:54:15.554638 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:54:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:55:30.163888 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:55:30.164487 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:55:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:55:34.184597 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:55:34.185151 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:55:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:55:35.651896 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:55:35.652472 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:55:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:57:26.878119 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:57:26.878637 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:57:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:57:35.561768 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:57:35.562428 dv-cinder-844140-1-iscsi devstack@n-api.service[124589]: Tue May 31 22:57:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 31 22:57:41.787049 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 31 22:57:41.787547 dv-cinder-844140-1-iscsi devstack@n-api.service[124590]: Tue May 31 22:57:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!